Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 912460 Details for
Bug 1113670
Unable to extend image over jsonrpc
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm log
vdsm.log (text/x-log), 1.16 MB, created by
Petr Beňas
on 2014-06-26 15:13:23 UTC
(
hide
)
Description:
vdsm log
Filename:
MIME Type:
Creator:
Petr Beňas
Created:
2014-06-26 15:13:23 UTC
Size:
1.16 MB
patch
obsolete
>Dummy-208::DEBUG::2014-06-26 17:01:03,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:04,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122806 s, 83.4 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:01:04,186::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 79aa2072-3ab5-4887-865c-dbb4b6467849 >Thread-160::DEBUG::2014-06-26 17:01:04,192::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849 >Thread-160::DEBUG::2014-06-26 17:01:04,192::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-160::DEBUG::2014-06-26 17:01:04,194::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=master', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=34', 'POOL_DOMAINS=9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=00161ead-084f-42e0-bbdf-6be74f182a50', 'REMOTE_PATH=10.34.63.202:/mnt/export/nfs/lv3/pbenas/35', 'ROLE=Master', 'SDUUID=79aa2072-3ab5-4887-865c-dbb4b6467849', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=b52410f15cd0b1978afafaf4ca1d215a2d5da3ce'] >Thread-160::DEBUG::2014-06-26 17:01:04,195::fileSD::619::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-160::INFO::2014-06-26 17:01:04,195::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 79aa2072-3ab5-4887-865c-dbb4b6467849_imageNS already registered >Thread-160::INFO::2014-06-26 17:01:04,196::sd::391::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 79aa2072-3ab5-4887-865c-dbb4b6467849_volumeNS already registered >Thread-160::DEBUG::2014-06-26 17:01:04,196::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:01:04,203::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000167505 s, 3.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:04,678::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:04,678::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:04,678::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:04,678::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:04,679::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:04,679::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720887::DEBUG::2014-06-26 17:01:04,679::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:01:04,679::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720887::DEBUG::2014-06-26 17:01:04,681::task::595::Storage.TaskManager.Task::(_updateState) Task=`58e68f16-d706-43eb-a2df-a0eaad2ef12a`::moving from state init -> state preparing >Thread-720887::INFO::2014-06-26 17:01:04,681::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-720887::INFO::2014-06-26 17:01:04,681::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000421504', 'lastCheck': '7.7', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000167505', 'lastCheck': '0.5', 'valid': True}} >Thread-720887::DEBUG::2014-06-26 17:01:04,681::task::1191::Storage.TaskManager.Task::(prepare) Task=`58e68f16-d706-43eb-a2df-a0eaad2ef12a`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000421504', 'lastCheck': '7.7', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000167505', 'lastCheck': '0.5', 'valid': True}} >Thread-720887::DEBUG::2014-06-26 17:01:04,682::task::595::Storage.TaskManager.Task::(_updateState) Task=`58e68f16-d706-43eb-a2df-a0eaad2ef12a`::moving from state preparing -> state finished >Thread-720887::DEBUG::2014-06-26 17:01:04,682::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720887::DEBUG::2014-06-26 17:01:04,682::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720887::DEBUG::2014-06-26 17:01:04,682::task::993::Storage.TaskManager.Task::(_decref) Task=`58e68f16-d706-43eb-a2df-a0eaad2ef12a`::ref 0 aborting False >Thread-720887::DEBUG::2014-06-26 17:01:04,684::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:04,709::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:04,709::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:04,709::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:04,709::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:04,710::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:04,710::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:04,710::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720888::DEBUG::2014-06-26 17:01:04,710::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-720888::DEBUG::2014-06-26 17:01:04,711::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:05,252::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:05,252::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:05,252::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:05,253::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:05,253::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:05,253::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:05,253::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720889::DEBUG::2014-06-26 17:01:05,253::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-720889::DEBUG::2014-06-26 17:01:05,254::task::595::Storage.TaskManager.Task::(_updateState) Task=`e144526a-ff2f-4139-a7a2-781336204c71`::moving from state init -> state preparing >Thread-720889::INFO::2014-06-26 17:01:05,254::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720889::INFO::2014-06-26 17:01:05,254::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720889::DEBUG::2014-06-26 17:01:05,255::task::1191::Storage.TaskManager.Task::(prepare) Task=`e144526a-ff2f-4139-a7a2-781336204c71`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720889::DEBUG::2014-06-26 17:01:05,255::task::595::Storage.TaskManager.Task::(_updateState) Task=`e144526a-ff2f-4139-a7a2-781336204c71`::moving from state preparing -> state finished >Thread-720889::DEBUG::2014-06-26 17:01:05,255::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720889::DEBUG::2014-06-26 17:01:05,255::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720889::DEBUG::2014-06-26 17:01:05,255::task::993::Storage.TaskManager.Task::(_decref) Task=`e144526a-ff2f-4139-a7a2-781336204c71`::ref 0 aborting False >Thread-720889::DEBUG::2014-06-26 17:01:05,255::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:05,264::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:05,265::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:05,265::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:05,265::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:05,265::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:05,265::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:05,265::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720890::DEBUG::2014-06-26 17:01:05,265::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-720890::DEBUG::2014-06-26 17:01:05,266::task::595::Storage.TaskManager.Task::(_updateState) Task=`d02d7fe2-9f97-4fcd-ad07-976fd7e4aec5`::moving from state init -> state preparing >Thread-720890::INFO::2014-06-26 17:01:05,266::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720890::DEBUG::2014-06-26 17:01:05,267::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`696d9346-e95f-488e-9b0f-bd7416d1aa7b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720890::DEBUG::2014-06-26 17:01:05,267::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720890::DEBUG::2014-06-26 17:01:05,267::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720890::DEBUG::2014-06-26 17:01:05,267::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`696d9346-e95f-488e-9b0f-bd7416d1aa7b`::Granted request >Thread-720890::DEBUG::2014-06-26 17:01:05,267::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d02d7fe2-9f97-4fcd-ad07-976fd7e4aec5`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720890::DEBUG::2014-06-26 17:01:05,267::task::993::Storage.TaskManager.Task::(_decref) Task=`d02d7fe2-9f97-4fcd-ad07-976fd7e4aec5`::ref 1 aborting False >Thread-720890::INFO::2014-06-26 17:01:05,270::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720890::DEBUG::2014-06-26 17:01:05,270::task::1191::Storage.TaskManager.Task::(prepare) Task=`d02d7fe2-9f97-4fcd-ad07-976fd7e4aec5`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720890::DEBUG::2014-06-26 17:01:05,270::task::595::Storage.TaskManager.Task::(_updateState) Task=`d02d7fe2-9f97-4fcd-ad07-976fd7e4aec5`::moving from state preparing -> state finished >Thread-720890::DEBUG::2014-06-26 17:01:05,270::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720890::DEBUG::2014-06-26 17:01:05,270::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720890::DEBUG::2014-06-26 17:01:05,270::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720890::DEBUG::2014-06-26 17:01:05,270::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720890::DEBUG::2014-06-26 17:01:05,270::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720890::DEBUG::2014-06-26 17:01:05,270::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720890::DEBUG::2014-06-26 17:01:05,271::task::993::Storage.TaskManager.Task::(_decref) Task=`d02d7fe2-9f97-4fcd-ad07-976fd7e4aec5`::ref 0 aborting False >Thread-720890::DEBUG::2014-06-26 17:01:05,271::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:01:06,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:06,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120205 s, 85.2 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:01:06,936::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:01:06,944::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000466478 s, 842 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:07,734::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:07,734::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:07,734::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:07,734::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:07,734::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:07,734::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:07,735::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720891::DEBUG::2014-06-26 17:01:07,735::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720891::DEBUG::2014-06-26 17:01:07,736::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:01:08,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:08,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120249 s, 85.2 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:01:10,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:10,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116631 s, 87.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:10,745::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:10,745::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:10,745::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:10,745::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:10,746::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:10,746::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:10,746::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720892::DEBUG::2014-06-26 17:01:10,746::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720892::DEBUG::2014-06-26 17:01:10,748::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:01:12,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:12,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121702 s, 84.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:13,758::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:13,758::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:13,758::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:13,758::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:13,758::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:13,759::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:13,759::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720893::DEBUG::2014-06-26 17:01:13,759::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720893::DEBUG::2014-06-26 17:01:13,760::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:01:14,205::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:01:14,212::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000293885 s, 1.9 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:01:14,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:14,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117288 s, 87.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:15,290::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:15,290::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:15,290::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:15,290::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:15,291::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:15,291::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:15,292::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720894::DEBUG::2014-06-26 17:01:15,292::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-720894::DEBUG::2014-06-26 17:01:15,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`34f83e74-de88-4e94-b609-ae5801ef8391`::moving from state init -> state preparing >Thread-720894::INFO::2014-06-26 17:01:15,293::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720894::INFO::2014-06-26 17:01:15,293::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720894::DEBUG::2014-06-26 17:01:15,293::task::1191::Storage.TaskManager.Task::(prepare) Task=`34f83e74-de88-4e94-b609-ae5801ef8391`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720894::DEBUG::2014-06-26 17:01:15,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`34f83e74-de88-4e94-b609-ae5801ef8391`::moving from state preparing -> state finished >Thread-720894::DEBUG::2014-06-26 17:01:15,293::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720894::DEBUG::2014-06-26 17:01:15,293::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720894::DEBUG::2014-06-26 17:01:15,293::task::993::Storage.TaskManager.Task::(_decref) Task=`34f83e74-de88-4e94-b609-ae5801ef8391`::ref 0 aborting False >Thread-720894::DEBUG::2014-06-26 17:01:15,294::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:15,330::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:15,330::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:15,330::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:15,331::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:15,331::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:15,331::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:15,331::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720895::DEBUG::2014-06-26 17:01:15,331::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-720895::DEBUG::2014-06-26 17:01:15,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d23ff7a-ff8e-4b13-be82-e8c432a629c0`::moving from state init -> state preparing >Thread-720895::INFO::2014-06-26 17:01:15,332::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720895::DEBUG::2014-06-26 17:01:15,332::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`560c99ac-157a-4e18-b55a-f203ab29879c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720895::DEBUG::2014-06-26 17:01:15,333::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720895::DEBUG::2014-06-26 17:01:15,333::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720895::DEBUG::2014-06-26 17:01:15,333::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`560c99ac-157a-4e18-b55a-f203ab29879c`::Granted request >Thread-720895::DEBUG::2014-06-26 17:01:15,333::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1d23ff7a-ff8e-4b13-be82-e8c432a629c0`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720895::DEBUG::2014-06-26 17:01:15,333::task::993::Storage.TaskManager.Task::(_decref) Task=`1d23ff7a-ff8e-4b13-be82-e8c432a629c0`::ref 1 aborting False >Thread-720895::INFO::2014-06-26 17:01:15,335::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720895::DEBUG::2014-06-26 17:01:15,335::task::1191::Storage.TaskManager.Task::(prepare) Task=`1d23ff7a-ff8e-4b13-be82-e8c432a629c0`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720895::DEBUG::2014-06-26 17:01:15,335::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d23ff7a-ff8e-4b13-be82-e8c432a629c0`::moving from state preparing -> state finished >Thread-720895::DEBUG::2014-06-26 17:01:15,336::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720895::DEBUG::2014-06-26 17:01:15,336::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720895::DEBUG::2014-06-26 17:01:15,336::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720895::DEBUG::2014-06-26 17:01:15,336::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720895::DEBUG::2014-06-26 17:01:15,336::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720895::DEBUG::2014-06-26 17:01:15,336::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720895::DEBUG::2014-06-26 17:01:15,336::task::993::Storage.TaskManager.Task::(_decref) Task=`1d23ff7a-ff8e-4b13-be82-e8c432a629c0`::ref 0 aborting False >Thread-720895::DEBUG::2014-06-26 17:01:15,337::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:01:16,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:16,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119507 s, 85.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:16,772::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:16,772::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:16,772::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:16,772::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:16,772::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:16,773::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:16,773::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720896::DEBUG::2014-06-26 17:01:16,773::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720896::DEBUG::2014-06-26 17:01:16,774::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:01:16,948::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:01:16,955::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000515904 s, 762 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:01:18,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:18,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176396 s, 58.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:19,786::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:19,786::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:19,787::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:19,787::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:19,787::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:19,787::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720897::DEBUG::2014-06-26 17:01:19,788::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:01:19,788::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720897::DEBUG::2014-06-26 17:01:19,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee080f18-1a5f-4615-8119-dd4d20ead8d9`::moving from state init -> state preparing >Thread-720897::INFO::2014-06-26 17:01:19,789::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-720897::INFO::2014-06-26 17:01:19,790::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000515904', 'lastCheck': '2.8', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000293885', 'lastCheck': '5.6', 'valid': True}} >Thread-720897::DEBUG::2014-06-26 17:01:19,790::task::1191::Storage.TaskManager.Task::(prepare) Task=`ee080f18-1a5f-4615-8119-dd4d20ead8d9`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000515904', 'lastCheck': '2.8', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000293885', 'lastCheck': '5.6', 'valid': True}} >Thread-720897::DEBUG::2014-06-26 17:01:19,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee080f18-1a5f-4615-8119-dd4d20ead8d9`::moving from state preparing -> state finished >Thread-720897::DEBUG::2014-06-26 17:01:19,790::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720897::DEBUG::2014-06-26 17:01:19,790::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720897::DEBUG::2014-06-26 17:01:19,790::task::993::Storage.TaskManager.Task::(_decref) Task=`ee080f18-1a5f-4615-8119-dd4d20ead8d9`::ref 0 aborting False >Thread-720897::DEBUG::2014-06-26 17:01:19,792::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:19,825::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:19,825::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:19,825::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:19,825::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:19,825::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:19,826::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:19,826::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720898::DEBUG::2014-06-26 17:01:19,826::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-720898::DEBUG::2014-06-26 17:01:19,827::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:01:20,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:20,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118814 s, 86.2 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:01:22,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:22,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0159254 s, 64.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:22,857::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:22,858::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:22,858::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:22,858::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:22,858::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:22,858::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:22,859::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720899::DEBUG::2014-06-26 17:01:22,859::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720899::DEBUG::2014-06-26 17:01:22,860::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:01:24,215::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:01:24,222::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000263616 s, 2.1 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:01:24,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:24,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116035 s, 88.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:25,363::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:25,364::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:25,364::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:25,364::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:25,364::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:25,364::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720900::DEBUG::2014-06-26 17:01:25,365::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:01:25,365::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720900::DEBUG::2014-06-26 17:01:25,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`c08cb298-1ea1-4625-ae3a-b0930f45568c`::moving from state init -> state preparing >Thread-720900::INFO::2014-06-26 17:01:25,366::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720900::INFO::2014-06-26 17:01:25,366::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720900::DEBUG::2014-06-26 17:01:25,367::task::1191::Storage.TaskManager.Task::(prepare) Task=`c08cb298-1ea1-4625-ae3a-b0930f45568c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720900::DEBUG::2014-06-26 17:01:25,367::task::595::Storage.TaskManager.Task::(_updateState) Task=`c08cb298-1ea1-4625-ae3a-b0930f45568c`::moving from state preparing -> state finished >Thread-720900::DEBUG::2014-06-26 17:01:25,367::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720900::DEBUG::2014-06-26 17:01:25,367::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720900::DEBUG::2014-06-26 17:01:25,367::task::993::Storage.TaskManager.Task::(_decref) Task=`c08cb298-1ea1-4625-ae3a-b0930f45568c`::ref 0 aborting False >Thread-720900::DEBUG::2014-06-26 17:01:25,367::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:25,381::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:25,381::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:25,382::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:25,382::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:25,382::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:25,382::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:25,382::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720901::DEBUG::2014-06-26 17:01:25,382::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-720901::DEBUG::2014-06-26 17:01:25,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`797592d5-570d-491e-a2f2-b4a0f1cdb297`::moving from state init -> state preparing >Thread-720901::INFO::2014-06-26 17:01:25,383::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720901::DEBUG::2014-06-26 17:01:25,384::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`05ac21d0-7f51-4b51-8284-ab7e7790387c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720901::DEBUG::2014-06-26 17:01:25,384::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720901::DEBUG::2014-06-26 17:01:25,384::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720901::DEBUG::2014-06-26 17:01:25,384::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`05ac21d0-7f51-4b51-8284-ab7e7790387c`::Granted request >Thread-720901::DEBUG::2014-06-26 17:01:25,384::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`797592d5-570d-491e-a2f2-b4a0f1cdb297`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720901::DEBUG::2014-06-26 17:01:25,384::task::993::Storage.TaskManager.Task::(_decref) Task=`797592d5-570d-491e-a2f2-b4a0f1cdb297`::ref 1 aborting False >Thread-720901::INFO::2014-06-26 17:01:25,386::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720901::DEBUG::2014-06-26 17:01:25,387::task::1191::Storage.TaskManager.Task::(prepare) Task=`797592d5-570d-491e-a2f2-b4a0f1cdb297`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720901::DEBUG::2014-06-26 17:01:25,387::task::595::Storage.TaskManager.Task::(_updateState) Task=`797592d5-570d-491e-a2f2-b4a0f1cdb297`::moving from state preparing -> state finished >Thread-720901::DEBUG::2014-06-26 17:01:25,387::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720901::DEBUG::2014-06-26 17:01:25,387::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720901::DEBUG::2014-06-26 17:01:25,387::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720901::DEBUG::2014-06-26 17:01:25,387::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720901::DEBUG::2014-06-26 17:01:25,387::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720901::DEBUG::2014-06-26 17:01:25,387::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720901::DEBUG::2014-06-26 17:01:25,387::task::993::Storage.TaskManager.Task::(_decref) Task=`797592d5-570d-491e-a2f2-b4a0f1cdb297`::ref 0 aborting False >Thread-720901::DEBUG::2014-06-26 17:01:25,388::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:25,870::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:25,870::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:25,870::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:25,870::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:25,871::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:25,871::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:25,871::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720902::DEBUG::2014-06-26 17:01:25,871::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720902::DEBUG::2014-06-26 17:01:25,872::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:01:26,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:26,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115817 s, 88.4 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:01:26,958::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:01:26,966::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000524728 s, 749 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:01:28,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:28,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117247 s, 87.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:28,883::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:28,883::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:28,883::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:28,883::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:28,884::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:28,884::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:28,884::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720903::DEBUG::2014-06-26 17:01:28,884::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720903::DEBUG::2014-06-26 17:01:28,885::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:01:30,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:30,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116676 s, 87.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:31,896::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:31,896::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:31,896::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:31,896::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:31,897::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:31,897::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:31,897::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720904::DEBUG::2014-06-26 17:01:31,897::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720904::DEBUG::2014-06-26 17:01:31,899::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:01:32,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:32,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117575 s, 87.1 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:01:34,224::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:01:34,231::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000262259 s, 2.1 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:01:34,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:34,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118594 s, 86.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:34,909::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:34,909::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:34,909::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:34,909::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:34,909::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:34,909::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720905::DEBUG::2014-06-26 17:01:34,910::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:01:34,910::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720905::DEBUG::2014-06-26 17:01:34,912::task::595::Storage.TaskManager.Task::(_updateState) Task=`18bcb6c7-626c-45ab-bb5a-f956f3150d08`::moving from state init -> state preparing >Thread-720905::INFO::2014-06-26 17:01:34,913::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-720905::INFO::2014-06-26 17:01:34,913::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524728', 'lastCheck': '7.9', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000262259', 'lastCheck': '0.7', 'valid': True}} >Thread-720905::DEBUG::2014-06-26 17:01:34,913::task::1191::Storage.TaskManager.Task::(prepare) Task=`18bcb6c7-626c-45ab-bb5a-f956f3150d08`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524728', 'lastCheck': '7.9', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000262259', 'lastCheck': '0.7', 'valid': True}} >Thread-720905::DEBUG::2014-06-26 17:01:34,913::task::595::Storage.TaskManager.Task::(_updateState) Task=`18bcb6c7-626c-45ab-bb5a-f956f3150d08`::moving from state preparing -> state finished >Thread-720905::DEBUG::2014-06-26 17:01:34,913::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720905::DEBUG::2014-06-26 17:01:34,913::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720905::DEBUG::2014-06-26 17:01:34,913::task::993::Storage.TaskManager.Task::(_decref) Task=`18bcb6c7-626c-45ab-bb5a-f956f3150d08`::ref 0 aborting False >Thread-720905::DEBUG::2014-06-26 17:01:34,915::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:34,950::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:34,951::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:34,951::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:34,951::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:34,951::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:34,951::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:34,951::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720906::DEBUG::2014-06-26 17:01:34,951::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-720906::DEBUG::2014-06-26 17:01:34,952::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:35,420::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:35,420::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:35,420::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:35,420::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:35,420::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:35,420::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720907::DEBUG::2014-06-26 17:01:35,421::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:01:35,421::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720907::DEBUG::2014-06-26 17:01:35,422::task::595::Storage.TaskManager.Task::(_updateState) Task=`31e9693e-27cf-49bc-b98d-0ad2ef049dcd`::moving from state init -> state preparing >Thread-720907::INFO::2014-06-26 17:01:35,422::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720907::INFO::2014-06-26 17:01:35,422::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720907::DEBUG::2014-06-26 17:01:35,422::task::1191::Storage.TaskManager.Task::(prepare) Task=`31e9693e-27cf-49bc-b98d-0ad2ef049dcd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720907::DEBUG::2014-06-26 17:01:35,422::task::595::Storage.TaskManager.Task::(_updateState) Task=`31e9693e-27cf-49bc-b98d-0ad2ef049dcd`::moving from state preparing -> state finished >Thread-720907::DEBUG::2014-06-26 17:01:35,422::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720907::DEBUG::2014-06-26 17:01:35,422::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720907::DEBUG::2014-06-26 17:01:35,423::task::993::Storage.TaskManager.Task::(_decref) Task=`31e9693e-27cf-49bc-b98d-0ad2ef049dcd`::ref 0 aborting False >Thread-720907::DEBUG::2014-06-26 17:01:35,423::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:35,436::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:35,436::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:35,437::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:35,437::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:35,437::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:35,437::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:35,437::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720908::DEBUG::2014-06-26 17:01:35,437::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-720908::DEBUG::2014-06-26 17:01:35,438::task::595::Storage.TaskManager.Task::(_updateState) Task=`13584924-081c-44cb-8fee-691c94487aa4`::moving from state init -> state preparing >Thread-720908::INFO::2014-06-26 17:01:35,438::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720908::DEBUG::2014-06-26 17:01:35,438::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`7a986e05-28bf-4787-8514-49311f307d38`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720908::DEBUG::2014-06-26 17:01:35,438::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720908::DEBUG::2014-06-26 17:01:35,439::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720908::DEBUG::2014-06-26 17:01:35,439::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`7a986e05-28bf-4787-8514-49311f307d38`::Granted request >Thread-720908::DEBUG::2014-06-26 17:01:35,439::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`13584924-081c-44cb-8fee-691c94487aa4`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720908::DEBUG::2014-06-26 17:01:35,439::task::993::Storage.TaskManager.Task::(_decref) Task=`13584924-081c-44cb-8fee-691c94487aa4`::ref 1 aborting False >Thread-720908::INFO::2014-06-26 17:01:35,441::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720908::DEBUG::2014-06-26 17:01:35,441::task::1191::Storage.TaskManager.Task::(prepare) Task=`13584924-081c-44cb-8fee-691c94487aa4`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720908::DEBUG::2014-06-26 17:01:35,442::task::595::Storage.TaskManager.Task::(_updateState) Task=`13584924-081c-44cb-8fee-691c94487aa4`::moving from state preparing -> state finished >Thread-720908::DEBUG::2014-06-26 17:01:35,442::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720908::DEBUG::2014-06-26 17:01:35,442::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720908::DEBUG::2014-06-26 17:01:35,442::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720908::DEBUG::2014-06-26 17:01:35,442::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720908::DEBUG::2014-06-26 17:01:35,442::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720908::DEBUG::2014-06-26 17:01:35,442::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720908::DEBUG::2014-06-26 17:01:35,442::task::993::Storage.TaskManager.Task::(_decref) Task=`13584924-081c-44cb-8fee-691c94487aa4`::ref 0 aborting False >Thread-720908::DEBUG::2014-06-26 17:01:35,443::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:01:36,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:36,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0197515 s, 51.8 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:01:36,968::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767 >Thread-123053::DEBUG::2014-06-26 17:01:36,983::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767 >Thread-123053::DEBUG::2014-06-26 17:01:36,984::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-123053::DEBUG::2014-06-26 17:01:36,987::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISO_DOMAIN', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00161ead-084f-42e0-bbdf-6be74f182a50', 'REMOTE_PATH=pb-rh35.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140616114208', 'ROLE=Regular', 'SDUUID=9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=32a5a6165ec7c85578dcde10da95cc8a94201d29'] >Thread-123053::DEBUG::2014-06-26 17:01:36,990::fileSD::619::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-123053::INFO::2014-06-26 17:01:36,990::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767_imageNS already registered >Thread-123053::INFO::2014-06-26 17:01:36,991::sd::391::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767_volumeNS already registered >Thread-123053::DEBUG::2014-06-26 17:01:36,993::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:01:37,001::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000397374 s, 989 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:37,990::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:37,990::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:37,991::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:37,991::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:37,991::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:37,991::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:37,992::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720913::DEBUG::2014-06-26 17:01:37,992::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720913::DEBUG::2014-06-26 17:01:37,993::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:01:38,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:38,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119774 s, 85.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:41,006::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:41,006::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:41,006::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:41,006::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:41,007::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:41,007::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720914::DEBUG::2014-06-26 17:01:41,007::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:01:41,007::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Dummy-208::DEBUG::2014-06-26 17:01:41,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-720914::DEBUG::2014-06-26 17:01:41,016::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:01:41,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115963 s, 88.3 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:01:43,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:43,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115297 s, 88.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:44,030::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:44,030::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:44,030::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:44,030::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:44,030::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:44,030::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720915::DEBUG::2014-06-26 17:01:44,031::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:01:44,031::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720915::DEBUG::2014-06-26 17:01:44,032::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:01:44,233::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:01:44,240::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000237533 s, 2.4 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:01:45,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:45,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117691 s, 87.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:45,466::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:45,466::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:45,466::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:45,466::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:45,467::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:45,467::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:45,467::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720916::DEBUG::2014-06-26 17:01:45,467::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-720916::DEBUG::2014-06-26 17:01:45,468::task::595::Storage.TaskManager.Task::(_updateState) Task=`739e7a9c-2c7e-49ca-ac1d-b06000042621`::moving from state init -> state preparing >Thread-720916::INFO::2014-06-26 17:01:45,468::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720916::INFO::2014-06-26 17:01:45,469::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720916::DEBUG::2014-06-26 17:01:45,469::task::1191::Storage.TaskManager.Task::(prepare) Task=`739e7a9c-2c7e-49ca-ac1d-b06000042621`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720916::DEBUG::2014-06-26 17:01:45,469::task::595::Storage.TaskManager.Task::(_updateState) Task=`739e7a9c-2c7e-49ca-ac1d-b06000042621`::moving from state preparing -> state finished >Thread-720916::DEBUG::2014-06-26 17:01:45,469::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720916::DEBUG::2014-06-26 17:01:45,469::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720916::DEBUG::2014-06-26 17:01:45,469::task::993::Storage.TaskManager.Task::(_decref) Task=`739e7a9c-2c7e-49ca-ac1d-b06000042621`::ref 0 aborting False >Thread-720916::DEBUG::2014-06-26 17:01:45,469::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:45,484::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:45,484::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:45,485::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:45,485::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:45,485::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:45,485::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:45,485::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720917::DEBUG::2014-06-26 17:01:45,485::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-720917::DEBUG::2014-06-26 17:01:45,486::task::595::Storage.TaskManager.Task::(_updateState) Task=`b28fa9c1-9a5f-47b1-864b-dd43519bf016`::moving from state init -> state preparing >Thread-720917::INFO::2014-06-26 17:01:45,486::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720917::DEBUG::2014-06-26 17:01:45,486::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`dabd520b-e66c-4a7e-a7e2-bebac2bdc238`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720917::DEBUG::2014-06-26 17:01:45,487::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720917::DEBUG::2014-06-26 17:01:45,487::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720917::DEBUG::2014-06-26 17:01:45,487::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`dabd520b-e66c-4a7e-a7e2-bebac2bdc238`::Granted request >Thread-720917::DEBUG::2014-06-26 17:01:45,487::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b28fa9c1-9a5f-47b1-864b-dd43519bf016`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720917::DEBUG::2014-06-26 17:01:45,487::task::993::Storage.TaskManager.Task::(_decref) Task=`b28fa9c1-9a5f-47b1-864b-dd43519bf016`::ref 1 aborting False >Thread-720917::INFO::2014-06-26 17:01:45,489::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720917::DEBUG::2014-06-26 17:01:45,490::task::1191::Storage.TaskManager.Task::(prepare) Task=`b28fa9c1-9a5f-47b1-864b-dd43519bf016`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720917::DEBUG::2014-06-26 17:01:45,490::task::595::Storage.TaskManager.Task::(_updateState) Task=`b28fa9c1-9a5f-47b1-864b-dd43519bf016`::moving from state preparing -> state finished >Thread-720917::DEBUG::2014-06-26 17:01:45,490::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720917::DEBUG::2014-06-26 17:01:45,490::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720917::DEBUG::2014-06-26 17:01:45,490::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720917::DEBUG::2014-06-26 17:01:45,490::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720917::DEBUG::2014-06-26 17:01:45,490::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720917::DEBUG::2014-06-26 17:01:45,490::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720917::DEBUG::2014-06-26 17:01:45,490::task::993::Storage.TaskManager.Task::(_decref) Task=`b28fa9c1-9a5f-47b1-864b-dd43519bf016`::ref 0 aborting False >Thread-720917::DEBUG::2014-06-26 17:01:45,491::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:01:47,005::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:01:47,012::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000434814 s, 904 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:47,044::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:47,044::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:47,044::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:47,044::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:47,044::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:47,044::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:47,045::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720918::DEBUG::2014-06-26 17:01:47,045::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720918::DEBUG::2014-06-26 17:01:47,046::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:01:47,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:47,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011772 s, 87.0 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:01:49,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:49,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120045 s, 85.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:50,056::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:50,056::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:50,056::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:50,056::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:50,057::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:50,057::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:50,057::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720919::DEBUG::2014-06-26 17:01:50,057::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-720919::DEBUG::2014-06-26 17:01:50,059::task::595::Storage.TaskManager.Task::(_updateState) Task=`d10fcfd1-a7e6-4cb7-871f-2fcef7d18be7`::moving from state init -> state preparing >Thread-720919::INFO::2014-06-26 17:01:50,059::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-720919::INFO::2014-06-26 17:01:50,059::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000434814', 'lastCheck': '3.0', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000237533', 'lastCheck': '5.8', 'valid': True}} >Thread-720919::DEBUG::2014-06-26 17:01:50,059::task::1191::Storage.TaskManager.Task::(prepare) Task=`d10fcfd1-a7e6-4cb7-871f-2fcef7d18be7`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000434814', 'lastCheck': '3.0', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000237533', 'lastCheck': '5.8', 'valid': True}} >Thread-720919::DEBUG::2014-06-26 17:01:50,059::task::595::Storage.TaskManager.Task::(_updateState) Task=`d10fcfd1-a7e6-4cb7-871f-2fcef7d18be7`::moving from state preparing -> state finished >Thread-720919::DEBUG::2014-06-26 17:01:50,059::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720919::DEBUG::2014-06-26 17:01:50,059::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720919::DEBUG::2014-06-26 17:01:50,060::task::993::Storage.TaskManager.Task::(_decref) Task=`d10fcfd1-a7e6-4cb7-871f-2fcef7d18be7`::ref 0 aborting False >Thread-720919::DEBUG::2014-06-26 17:01:50,061::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:50,088::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:50,088::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:50,088::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:50,088::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:50,088::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:50,088::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720920::DEBUG::2014-06-26 17:01:50,089::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:01:50,089::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720920::DEBUG::2014-06-26 17:01:50,090::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:01:51,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:51,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119599 s, 85.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:53,118::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:53,118::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:53,118::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:53,118::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:53,119::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:53,119::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:53,119::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720921::DEBUG::2014-06-26 17:01:53,119::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720921::DEBUG::2014-06-26 17:01:53,120::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:01:53,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:53,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119969 s, 85.4 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:01:54,242::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:01:54,249::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000260091 s, 2.1 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:01:55,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:55,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0188241 s, 54.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:55,519::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:55,519::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:55,520::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:55,520::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:55,520::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:55,520::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720922::DEBUG::2014-06-26 17:01:55,521::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:01:55,521::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720922::DEBUG::2014-06-26 17:01:55,522::task::595::Storage.TaskManager.Task::(_updateState) Task=`f068df8e-52c4-4c2b-9995-5d0ba51abb7a`::moving from state init -> state preparing >Thread-720922::INFO::2014-06-26 17:01:55,522::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720922::INFO::2014-06-26 17:01:55,522::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720922::DEBUG::2014-06-26 17:01:55,522::task::1191::Storage.TaskManager.Task::(prepare) Task=`f068df8e-52c4-4c2b-9995-5d0ba51abb7a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720922::DEBUG::2014-06-26 17:01:55,522::task::595::Storage.TaskManager.Task::(_updateState) Task=`f068df8e-52c4-4c2b-9995-5d0ba51abb7a`::moving from state preparing -> state finished >Thread-720922::DEBUG::2014-06-26 17:01:55,523::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720922::DEBUG::2014-06-26 17:01:55,523::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720922::DEBUG::2014-06-26 17:01:55,523::task::993::Storage.TaskManager.Task::(_decref) Task=`f068df8e-52c4-4c2b-9995-5d0ba51abb7a`::ref 0 aborting False >Thread-720922::DEBUG::2014-06-26 17:01:55,523::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:55,537::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:55,538::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:55,538::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:55,538::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:55,538::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:55,538::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:55,538::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720923::DEBUG::2014-06-26 17:01:55,538::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-720923::DEBUG::2014-06-26 17:01:55,539::task::595::Storage.TaskManager.Task::(_updateState) Task=`6cf54b84-77ef-43d2-b245-5622a2d9f6a8`::moving from state init -> state preparing >Thread-720923::INFO::2014-06-26 17:01:55,539::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720923::DEBUG::2014-06-26 17:01:55,540::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`b4398422-01a5-49c3-804b-e20557c5c53d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720923::DEBUG::2014-06-26 17:01:55,540::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720923::DEBUG::2014-06-26 17:01:55,540::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720923::DEBUG::2014-06-26 17:01:55,540::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`b4398422-01a5-49c3-804b-e20557c5c53d`::Granted request >Thread-720923::DEBUG::2014-06-26 17:01:55,540::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6cf54b84-77ef-43d2-b245-5622a2d9f6a8`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720923::DEBUG::2014-06-26 17:01:55,540::task::993::Storage.TaskManager.Task::(_decref) Task=`6cf54b84-77ef-43d2-b245-5622a2d9f6a8`::ref 1 aborting False >Thread-720923::INFO::2014-06-26 17:01:55,543::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720923::DEBUG::2014-06-26 17:01:55,543::task::1191::Storage.TaskManager.Task::(prepare) Task=`6cf54b84-77ef-43d2-b245-5622a2d9f6a8`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720923::DEBUG::2014-06-26 17:01:55,543::task::595::Storage.TaskManager.Task::(_updateState) Task=`6cf54b84-77ef-43d2-b245-5622a2d9f6a8`::moving from state preparing -> state finished >Thread-720923::DEBUG::2014-06-26 17:01:55,543::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720923::DEBUG::2014-06-26 17:01:55,543::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720923::DEBUG::2014-06-26 17:01:55,543::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720923::DEBUG::2014-06-26 17:01:55,543::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720923::DEBUG::2014-06-26 17:01:55,543::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720923::DEBUG::2014-06-26 17:01:55,543::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720923::DEBUG::2014-06-26 17:01:55,543::task::993::Storage.TaskManager.Task::(_decref) Task=`6cf54b84-77ef-43d2-b245-5622a2d9f6a8`::ref 0 aborting False >Thread-720923::DEBUG::2014-06-26 17:01:55,544::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:56,131::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:56,131::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:56,131::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:56,131::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:56,131::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:56,132::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:01:56,132::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720924::DEBUG::2014-06-26 17:01:56,132::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720924::DEBUG::2014-06-26 17:01:56,133::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:01:57,015::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:01:57,022::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000552979 s, 711 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:01:57,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:57,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118957 s, 86.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:59,144::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:59,144::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:59,144::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:01:59,145::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:01:59,145::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:01:59,145::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720925::DEBUG::2014-06-26 17:01:59,146::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:01:59,146::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720925::DEBUG::2014-06-26 17:01:59,147::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:01:59,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:01:59,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117493 s, 87.2 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:02:01,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:01,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120464 s, 85.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:02,158::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:02,158::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:02,158::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:02,158::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:02,158::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:02,158::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:02,159::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720926::DEBUG::2014-06-26 17:02:02,159::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720926::DEBUG::2014-06-26 17:02:02,160::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:03,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:03,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120349 s, 85.1 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:02:04,251::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:02:04,258::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000261289 s, 2.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:05,172::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:05,172::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:05,172::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:05,173::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:05,173::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:05,173::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:05,174::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720927::DEBUG::2014-06-26 17:02:05,174::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-720927::DEBUG::2014-06-26 17:02:05,175::task::595::Storage.TaskManager.Task::(_updateState) Task=`c42939ea-9848-481f-b419-c889866497d1`::moving from state init -> state preparing >Thread-720927::INFO::2014-06-26 17:02:05,175::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-720927::INFO::2014-06-26 17:02:05,175::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000552979', 'lastCheck': '8.2', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000261289', 'lastCheck': '0.9', 'valid': True}} >Thread-720927::DEBUG::2014-06-26 17:02:05,175::task::1191::Storage.TaskManager.Task::(prepare) Task=`c42939ea-9848-481f-b419-c889866497d1`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000552979', 'lastCheck': '8.2', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000261289', 'lastCheck': '0.9', 'valid': True}} >Thread-720927::DEBUG::2014-06-26 17:02:05,176::task::595::Storage.TaskManager.Task::(_updateState) Task=`c42939ea-9848-481f-b419-c889866497d1`::moving from state preparing -> state finished >Thread-720927::DEBUG::2014-06-26 17:02:05,176::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720927::DEBUG::2014-06-26 17:02:05,176::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720927::DEBUG::2014-06-26 17:02:05,176::task::993::Storage.TaskManager.Task::(_decref) Task=`c42939ea-9848-481f-b419-c889866497d1`::ref 0 aborting False >Thread-720927::DEBUG::2014-06-26 17:02:05,178::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:05,211::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:05,211::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:05,211::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:05,211::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:05,212::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:05,212::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720928::DEBUG::2014-06-26 17:02:05,212::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:02:05,212::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720928::DEBUG::2014-06-26 17:02:05,213::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:05,570::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:05,570::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:05,570::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:05,570::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:05,570::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:05,570::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:05,571::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720929::DEBUG::2014-06-26 17:02:05,571::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-720929::DEBUG::2014-06-26 17:02:05,571::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c336d5c-70cc-4b21-a7f2-7d96951e6439`::moving from state init -> state preparing >Thread-720929::INFO::2014-06-26 17:02:05,572::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720929::INFO::2014-06-26 17:02:05,572::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720929::DEBUG::2014-06-26 17:02:05,572::task::1191::Storage.TaskManager.Task::(prepare) Task=`0c336d5c-70cc-4b21-a7f2-7d96951e6439`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720929::DEBUG::2014-06-26 17:02:05,572::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c336d5c-70cc-4b21-a7f2-7d96951e6439`::moving from state preparing -> state finished >Thread-720929::DEBUG::2014-06-26 17:02:05,572::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720929::DEBUG::2014-06-26 17:02:05,572::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720929::DEBUG::2014-06-26 17:02:05,572::task::993::Storage.TaskManager.Task::(_decref) Task=`0c336d5c-70cc-4b21-a7f2-7d96951e6439`::ref 0 aborting False >Thread-720929::DEBUG::2014-06-26 17:02:05,572::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:05,588::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:05,588::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:05,588::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:05,588::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:05,588::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:05,589::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:05,589::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720930::DEBUG::2014-06-26 17:02:05,589::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-720930::DEBUG::2014-06-26 17:02:05,590::task::595::Storage.TaskManager.Task::(_updateState) Task=`702e71e0-92fb-45cc-9b27-d69e6b6f718f`::moving from state init -> state preparing >Thread-720930::INFO::2014-06-26 17:02:05,590::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720930::DEBUG::2014-06-26 17:02:05,590::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`616f2610-c347-46cc-960d-548c93df1638`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720930::DEBUG::2014-06-26 17:02:05,590::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720930::DEBUG::2014-06-26 17:02:05,590::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720930::DEBUG::2014-06-26 17:02:05,590::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`616f2610-c347-46cc-960d-548c93df1638`::Granted request >Thread-720930::DEBUG::2014-06-26 17:02:05,591::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`702e71e0-92fb-45cc-9b27-d69e6b6f718f`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720930::DEBUG::2014-06-26 17:02:05,591::task::993::Storage.TaskManager.Task::(_decref) Task=`702e71e0-92fb-45cc-9b27-d69e6b6f718f`::ref 1 aborting False >Thread-720930::INFO::2014-06-26 17:02:05,594::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720930::DEBUG::2014-06-26 17:02:05,594::task::1191::Storage.TaskManager.Task::(prepare) Task=`702e71e0-92fb-45cc-9b27-d69e6b6f718f`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720930::DEBUG::2014-06-26 17:02:05,594::task::595::Storage.TaskManager.Task::(_updateState) Task=`702e71e0-92fb-45cc-9b27-d69e6b6f718f`::moving from state preparing -> state finished >Thread-720930::DEBUG::2014-06-26 17:02:05,594::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720930::DEBUG::2014-06-26 17:02:05,594::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720930::DEBUG::2014-06-26 17:02:05,594::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720930::DEBUG::2014-06-26 17:02:05,594::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720930::DEBUG::2014-06-26 17:02:05,594::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720930::DEBUG::2014-06-26 17:02:05,594::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720930::DEBUG::2014-06-26 17:02:05,595::task::993::Storage.TaskManager.Task::(_decref) Task=`702e71e0-92fb-45cc-9b27-d69e6b6f718f`::ref 0 aborting False >Thread-720930::DEBUG::2014-06-26 17:02:05,595::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:05,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:05,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.014458 s, 70.8 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:02:07,027::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:02:07,035::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000433159 s, 907 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:02:07,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:07,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117827 s, 86.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:08,250::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:08,250::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:08,250::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:08,251::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:08,251::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:08,251::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:08,251::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720931::DEBUG::2014-06-26 17:02:08,252::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720931::DEBUG::2014-06-26 17:02:08,253::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:09,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:09,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117844 s, 86.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:11,267::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:11,267::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:11,267::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:11,267::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:11,267::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:11,267::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720932::DEBUG::2014-06-26 17:02:11,268::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:02:11,268::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720932::DEBUG::2014-06-26 17:02:11,269::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:11,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:11,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118358 s, 86.5 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:02:13,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:13,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118221 s, 86.6 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:02:14,260::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:02:14,267::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000255771 s, 2.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:14,281::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:14,281::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:14,281::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:14,281::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:14,282::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:14,282::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:14,282::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720933::DEBUG::2014-06-26 17:02:14,283::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720933::DEBUG::2014-06-26 17:02:14,284::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:15,620::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:15,620::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:15,620::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:15,620::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:15,620::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:15,620::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720934::DEBUG::2014-06-26 17:02:15,621::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:02:15,621::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720934::DEBUG::2014-06-26 17:02:15,622::task::595::Storage.TaskManager.Task::(_updateState) Task=`273bf47a-30a8-46d4-bd5d-e41ecbb94d7c`::moving from state init -> state preparing >Thread-720934::INFO::2014-06-26 17:02:15,622::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720934::INFO::2014-06-26 17:02:15,622::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720934::DEBUG::2014-06-26 17:02:15,622::task::1191::Storage.TaskManager.Task::(prepare) Task=`273bf47a-30a8-46d4-bd5d-e41ecbb94d7c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720934::DEBUG::2014-06-26 17:02:15,622::task::595::Storage.TaskManager.Task::(_updateState) Task=`273bf47a-30a8-46d4-bd5d-e41ecbb94d7c`::moving from state preparing -> state finished >Thread-720934::DEBUG::2014-06-26 17:02:15,622::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720934::DEBUG::2014-06-26 17:02:15,623::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720934::DEBUG::2014-06-26 17:02:15,623::task::993::Storage.TaskManager.Task::(_decref) Task=`273bf47a-30a8-46d4-bd5d-e41ecbb94d7c`::ref 0 aborting False >Thread-720934::DEBUG::2014-06-26 17:02:15,623::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:15,639::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:15,640::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:15,640::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:15,640::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:15,640::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:15,640::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720935::DEBUG::2014-06-26 17:02:15,640::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:02:15,640::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720935::DEBUG::2014-06-26 17:02:15,641::task::595::Storage.TaskManager.Task::(_updateState) Task=`99b08179-48b8-4d74-a575-917a9b180e5b`::moving from state init -> state preparing >Thread-720935::INFO::2014-06-26 17:02:15,641::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720935::DEBUG::2014-06-26 17:02:15,642::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`441bb3b6-2f3c-4953-8f18-0ab0346b3d3c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720935::DEBUG::2014-06-26 17:02:15,642::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720935::DEBUG::2014-06-26 17:02:15,642::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720935::DEBUG::2014-06-26 17:02:15,642::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`441bb3b6-2f3c-4953-8f18-0ab0346b3d3c`::Granted request >Thread-720935::DEBUG::2014-06-26 17:02:15,642::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`99b08179-48b8-4d74-a575-917a9b180e5b`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720935::DEBUG::2014-06-26 17:02:15,642::task::993::Storage.TaskManager.Task::(_decref) Task=`99b08179-48b8-4d74-a575-917a9b180e5b`::ref 1 aborting False >Thread-720935::INFO::2014-06-26 17:02:15,645::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720935::DEBUG::2014-06-26 17:02:15,645::task::1191::Storage.TaskManager.Task::(prepare) Task=`99b08179-48b8-4d74-a575-917a9b180e5b`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720935::DEBUG::2014-06-26 17:02:15,645::task::595::Storage.TaskManager.Task::(_updateState) Task=`99b08179-48b8-4d74-a575-917a9b180e5b`::moving from state preparing -> state finished >Thread-720935::DEBUG::2014-06-26 17:02:15,645::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720935::DEBUG::2014-06-26 17:02:15,645::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720935::DEBUG::2014-06-26 17:02:15,645::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720935::DEBUG::2014-06-26 17:02:15,645::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720935::DEBUG::2014-06-26 17:02:15,645::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720935::DEBUG::2014-06-26 17:02:15,645::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720935::DEBUG::2014-06-26 17:02:15,646::task::993::Storage.TaskManager.Task::(_decref) Task=`99b08179-48b8-4d74-a575-917a9b180e5b`::ref 0 aborting False >Thread-720935::DEBUG::2014-06-26 17:02:15,646::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:15,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:15,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122469 s, 83.6 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:02:17,040::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:02:17,047::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000558168 s, 704 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:17,294::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:17,295::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:17,295::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:17,295::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:17,295::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:17,295::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:17,296::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720936::DEBUG::2014-06-26 17:02:17,296::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720936::DEBUG::2014-06-26 17:02:17,297::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:17,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:17,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118649 s, 86.3 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:02:19,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:20,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012138 s, 84.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:20,307::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:20,307::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:20,307::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:20,307::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:20,307::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:20,308::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:20,308::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720937::DEBUG::2014-06-26 17:02:20,308::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-720937::DEBUG::2014-06-26 17:02:20,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`af07bbbc-116b-4385-8fec-3885479811dd`::moving from state init -> state preparing >Thread-720937::INFO::2014-06-26 17:02:20,309::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-720937::INFO::2014-06-26 17:02:20,310::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000558168', 'lastCheck': '3.3', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255771', 'lastCheck': '6.0', 'valid': True}} >Thread-720937::DEBUG::2014-06-26 17:02:20,310::task::1191::Storage.TaskManager.Task::(prepare) Task=`af07bbbc-116b-4385-8fec-3885479811dd`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000558168', 'lastCheck': '3.3', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255771', 'lastCheck': '6.0', 'valid': True}} >Thread-720937::DEBUG::2014-06-26 17:02:20,310::task::595::Storage.TaskManager.Task::(_updateState) Task=`af07bbbc-116b-4385-8fec-3885479811dd`::moving from state preparing -> state finished >Thread-720937::DEBUG::2014-06-26 17:02:20,310::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720937::DEBUG::2014-06-26 17:02:20,310::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720937::DEBUG::2014-06-26 17:02:20,310::task::993::Storage.TaskManager.Task::(_decref) Task=`af07bbbc-116b-4385-8fec-3885479811dd`::ref 0 aborting False >Thread-720937::DEBUG::2014-06-26 17:02:20,312::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:20,345::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:20,345::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:20,345::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:20,345::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:20,345::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:20,346::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:20,346::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720938::DEBUG::2014-06-26 17:02:20,346::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-720938::DEBUG::2014-06-26 17:02:20,347::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:22,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:22,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117655 s, 87.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:23,387::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:23,387::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:23,387::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:23,387::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:23,387::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:23,388::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720939::DEBUG::2014-06-26 17:02:23,388::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:02:23,388::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720939::DEBUG::2014-06-26 17:02:23,389::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:24,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:24,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011547 s, 88.7 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:02:24,270::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:02:24,276::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000248197 s, 2.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:25,670::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:25,670::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:25,671::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:25,671::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:25,671::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:25,671::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:25,672::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720940::DEBUG::2014-06-26 17:02:25,672::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-720940::DEBUG::2014-06-26 17:02:25,673::task::595::Storage.TaskManager.Task::(_updateState) Task=`96be411f-da1f-4a79-9965-c59aec7a349f`::moving from state init -> state preparing >Thread-720940::INFO::2014-06-26 17:02:25,673::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720940::INFO::2014-06-26 17:02:25,673::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720940::DEBUG::2014-06-26 17:02:25,673::task::1191::Storage.TaskManager.Task::(prepare) Task=`96be411f-da1f-4a79-9965-c59aec7a349f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720940::DEBUG::2014-06-26 17:02:25,673::task::595::Storage.TaskManager.Task::(_updateState) Task=`96be411f-da1f-4a79-9965-c59aec7a349f`::moving from state preparing -> state finished >Thread-720940::DEBUG::2014-06-26 17:02:25,673::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720940::DEBUG::2014-06-26 17:02:25,673::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720940::DEBUG::2014-06-26 17:02:25,673::task::993::Storage.TaskManager.Task::(_decref) Task=`96be411f-da1f-4a79-9965-c59aec7a349f`::ref 0 aborting False >Thread-720940::DEBUG::2014-06-26 17:02:25,674::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:25,688::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:25,688::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:25,688::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:25,689::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:25,689::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:25,689::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:25,689::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720941::DEBUG::2014-06-26 17:02:25,689::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-720941::DEBUG::2014-06-26 17:02:25,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e513b77-cacd-42cd-95bc-8c7566e03754`::moving from state init -> state preparing >Thread-720941::INFO::2014-06-26 17:02:25,690::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720941::DEBUG::2014-06-26 17:02:25,690::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`d90682b7-4bc4-48ed-9926-2a880ceb88be`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720941::DEBUG::2014-06-26 17:02:25,691::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720941::DEBUG::2014-06-26 17:02:25,691::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720941::DEBUG::2014-06-26 17:02:25,691::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`d90682b7-4bc4-48ed-9926-2a880ceb88be`::Granted request >Thread-720941::DEBUG::2014-06-26 17:02:25,691::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1e513b77-cacd-42cd-95bc-8c7566e03754`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720941::DEBUG::2014-06-26 17:02:25,691::task::993::Storage.TaskManager.Task::(_decref) Task=`1e513b77-cacd-42cd-95bc-8c7566e03754`::ref 1 aborting False >Thread-720941::INFO::2014-06-26 17:02:25,693::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720941::DEBUG::2014-06-26 17:02:25,693::task::1191::Storage.TaskManager.Task::(prepare) Task=`1e513b77-cacd-42cd-95bc-8c7566e03754`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720941::DEBUG::2014-06-26 17:02:25,694::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e513b77-cacd-42cd-95bc-8c7566e03754`::moving from state preparing -> state finished >Thread-720941::DEBUG::2014-06-26 17:02:25,694::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720941::DEBUG::2014-06-26 17:02:25,694::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720941::DEBUG::2014-06-26 17:02:25,694::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720941::DEBUG::2014-06-26 17:02:25,694::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720941::DEBUG::2014-06-26 17:02:25,694::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720941::DEBUG::2014-06-26 17:02:25,694::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720941::DEBUG::2014-06-26 17:02:25,694::task::993::Storage.TaskManager.Task::(_decref) Task=`1e513b77-cacd-42cd-95bc-8c7566e03754`::ref 0 aborting False >Thread-720941::DEBUG::2014-06-26 17:02:25,695::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:26,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:26,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117957 s, 86.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:26,404::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:26,404::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:26,404::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:26,404::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:26,405::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:26,405::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:26,405::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720942::DEBUG::2014-06-26 17:02:26,405::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720942::DEBUG::2014-06-26 17:02:26,406::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:02:27,049::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:02:27,057::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000481555 s, 816 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:02:28,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:28,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011634 s, 88.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:29,417::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:29,417::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:29,417::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:29,417::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:29,417::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:29,417::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:29,418::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720943::DEBUG::2014-06-26 17:02:29,418::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720943::DEBUG::2014-06-26 17:02:29,419::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:30,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:30,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118799 s, 86.2 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:02:32,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:32,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011892 s, 86.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:32,429::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:32,430::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:32,430::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:32,430::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:32,430::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:32,430::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720944::DEBUG::2014-06-26 17:02:32,431::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:02:32,431::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720944::DEBUG::2014-06-26 17:02:32,432::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:02:34,279::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:02:34,285::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000301672 s, 1.9 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:02:34,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:34,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011611 s, 88.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:35,443::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:35,443::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:35,443::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:35,443::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:35,443::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:35,443::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720945::DEBUG::2014-06-26 17:02:35,444::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:02:35,444::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720945::DEBUG::2014-06-26 17:02:35,446::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c18c8c2-1bdd-455c-8737-83976346cb60`::moving from state init -> state preparing >Thread-720945::INFO::2014-06-26 17:02:35,446::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-720945::INFO::2014-06-26 17:02:35,446::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000481555', 'lastCheck': '8.4', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000301672', 'lastCheck': '1.2', 'valid': True}} >Thread-720945::DEBUG::2014-06-26 17:02:35,446::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c18c8c2-1bdd-455c-8737-83976346cb60`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000481555', 'lastCheck': '8.4', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000301672', 'lastCheck': '1.2', 'valid': True}} >Thread-720945::DEBUG::2014-06-26 17:02:35,446::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c18c8c2-1bdd-455c-8737-83976346cb60`::moving from state preparing -> state finished >Thread-720945::DEBUG::2014-06-26 17:02:35,446::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720945::DEBUG::2014-06-26 17:02:35,446::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720945::DEBUG::2014-06-26 17:02:35,446::task::993::Storage.TaskManager.Task::(_decref) Task=`7c18c8c2-1bdd-455c-8737-83976346cb60`::ref 0 aborting False >Thread-720945::DEBUG::2014-06-26 17:02:35,448::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:35,483::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:35,483::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:35,483::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:35,483::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:35,483::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:35,483::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:35,484::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720946::DEBUG::2014-06-26 17:02:35,484::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-720946::DEBUG::2014-06-26 17:02:35,485::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:35,718::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:35,718::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:35,718::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:35,718::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:35,718::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:35,718::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:35,719::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720947::DEBUG::2014-06-26 17:02:35,719::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-720947::DEBUG::2014-06-26 17:02:35,720::task::595::Storage.TaskManager.Task::(_updateState) Task=`6043492c-e206-4b9b-afa9-fa32e63f44f1`::moving from state init -> state preparing >Thread-720947::INFO::2014-06-26 17:02:35,720::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720947::INFO::2014-06-26 17:02:35,720::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720947::DEBUG::2014-06-26 17:02:35,720::task::1191::Storage.TaskManager.Task::(prepare) Task=`6043492c-e206-4b9b-afa9-fa32e63f44f1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720947::DEBUG::2014-06-26 17:02:35,720::task::595::Storage.TaskManager.Task::(_updateState) Task=`6043492c-e206-4b9b-afa9-fa32e63f44f1`::moving from state preparing -> state finished >Thread-720947::DEBUG::2014-06-26 17:02:35,720::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720947::DEBUG::2014-06-26 17:02:35,720::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720947::DEBUG::2014-06-26 17:02:35,721::task::993::Storage.TaskManager.Task::(_decref) Task=`6043492c-e206-4b9b-afa9-fa32e63f44f1`::ref 0 aborting False >Thread-720947::DEBUG::2014-06-26 17:02:35,721::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:35,737::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:35,737::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:35,737::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:35,737::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:35,737::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:35,737::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720948::DEBUG::2014-06-26 17:02:35,738::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:02:35,738::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720948::DEBUG::2014-06-26 17:02:35,738::task::595::Storage.TaskManager.Task::(_updateState) Task=`2db7baf3-c1c2-4536-8e61-8e112e170e95`::moving from state init -> state preparing >Thread-720948::INFO::2014-06-26 17:02:35,739::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720948::DEBUG::2014-06-26 17:02:35,739::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`92067ad2-0c74-44ae-afb8-bf6477b9fc96`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720948::DEBUG::2014-06-26 17:02:35,739::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720948::DEBUG::2014-06-26 17:02:35,739::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720948::DEBUG::2014-06-26 17:02:35,739::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`92067ad2-0c74-44ae-afb8-bf6477b9fc96`::Granted request >Thread-720948::DEBUG::2014-06-26 17:02:35,739::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2db7baf3-c1c2-4536-8e61-8e112e170e95`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720948::DEBUG::2014-06-26 17:02:35,740::task::993::Storage.TaskManager.Task::(_decref) Task=`2db7baf3-c1c2-4536-8e61-8e112e170e95`::ref 1 aborting False >Thread-720948::INFO::2014-06-26 17:02:35,742::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720948::DEBUG::2014-06-26 17:02:35,742::task::1191::Storage.TaskManager.Task::(prepare) Task=`2db7baf3-c1c2-4536-8e61-8e112e170e95`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720948::DEBUG::2014-06-26 17:02:35,742::task::595::Storage.TaskManager.Task::(_updateState) Task=`2db7baf3-c1c2-4536-8e61-8e112e170e95`::moving from state preparing -> state finished >Thread-720948::DEBUG::2014-06-26 17:02:35,742::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720948::DEBUG::2014-06-26 17:02:35,742::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720948::DEBUG::2014-06-26 17:02:35,742::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720948::DEBUG::2014-06-26 17:02:35,743::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720948::DEBUG::2014-06-26 17:02:35,743::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720948::DEBUG::2014-06-26 17:02:35,743::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720948::DEBUG::2014-06-26 17:02:35,743::task::993::Storage.TaskManager.Task::(_decref) Task=`2db7baf3-c1c2-4536-8e61-8e112e170e95`::ref 0 aborting False >Thread-720948::DEBUG::2014-06-26 17:02:35,743::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:36,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:36,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0204029 s, 50.2 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:02:37,061::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:02:37,068::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000443013 s, 887 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:38,519::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:38,520::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:38,520::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:38,520::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:38,520::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:38,520::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720949::DEBUG::2014-06-26 17:02:38,521::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:02:38,521::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720949::DEBUG::2014-06-26 17:02:38,522::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:38,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:38,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116536 s, 87.9 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:02:40,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:40,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116627 s, 87.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:41,536::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:41,537::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:41,537::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:41,537::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:41,537::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:41,538::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:41,539::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720950::DEBUG::2014-06-26 17:02:41,539::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720950::DEBUG::2014-06-26 17:02:41,540::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:42,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:42,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118749 s, 86.2 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:02:44,288::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:02:44,295::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000258925 s, 2.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:44,552::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:44,552::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:44,553::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:44,553::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:44,553::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:44,553::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720951::DEBUG::2014-06-26 17:02:44,554::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:02:44,554::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720951::DEBUG::2014-06-26 17:02:44,555::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:44,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:44,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131748 s, 77.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:45,770::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:45,770::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:45,770::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:45,770::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:45,770::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:45,770::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:45,771::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720952::DEBUG::2014-06-26 17:02:45,771::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-720952::DEBUG::2014-06-26 17:02:45,772::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c215784-4e58-4772-9469-a2c2f4701650`::moving from state init -> state preparing >Thread-720952::INFO::2014-06-26 17:02:45,772::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720952::INFO::2014-06-26 17:02:45,772::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720952::DEBUG::2014-06-26 17:02:45,773::task::1191::Storage.TaskManager.Task::(prepare) Task=`0c215784-4e58-4772-9469-a2c2f4701650`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720952::DEBUG::2014-06-26 17:02:45,773::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c215784-4e58-4772-9469-a2c2f4701650`::moving from state preparing -> state finished >Thread-720952::DEBUG::2014-06-26 17:02:45,773::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720952::DEBUG::2014-06-26 17:02:45,773::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720952::DEBUG::2014-06-26 17:02:45,773::task::993::Storage.TaskManager.Task::(_decref) Task=`0c215784-4e58-4772-9469-a2c2f4701650`::ref 0 aborting False >Thread-720952::DEBUG::2014-06-26 17:02:45,773::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:45,788::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:45,788::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:45,788::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:45,788::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:45,788::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:45,788::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:45,789::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720953::DEBUG::2014-06-26 17:02:45,789::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-720953::DEBUG::2014-06-26 17:02:45,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0f08516-68f2-46bb-9aa5-fea2d42c2c9f`::moving from state init -> state preparing >Thread-720953::INFO::2014-06-26 17:02:45,790::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720953::DEBUG::2014-06-26 17:02:45,790::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`74235f0a-db29-4813-908c-faa15c6d00e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720953::DEBUG::2014-06-26 17:02:45,790::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720953::DEBUG::2014-06-26 17:02:45,790::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720953::DEBUG::2014-06-26 17:02:45,790::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`74235f0a-db29-4813-908c-faa15c6d00e8`::Granted request >Thread-720953::DEBUG::2014-06-26 17:02:45,790::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a0f08516-68f2-46bb-9aa5-fea2d42c2c9f`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720953::DEBUG::2014-06-26 17:02:45,791::task::993::Storage.TaskManager.Task::(_decref) Task=`a0f08516-68f2-46bb-9aa5-fea2d42c2c9f`::ref 1 aborting False >Thread-720953::INFO::2014-06-26 17:02:45,793::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720953::DEBUG::2014-06-26 17:02:45,793::task::1191::Storage.TaskManager.Task::(prepare) Task=`a0f08516-68f2-46bb-9aa5-fea2d42c2c9f`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720953::DEBUG::2014-06-26 17:02:45,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0f08516-68f2-46bb-9aa5-fea2d42c2c9f`::moving from state preparing -> state finished >Thread-720953::DEBUG::2014-06-26 17:02:45,793::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720953::DEBUG::2014-06-26 17:02:45,793::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720953::DEBUG::2014-06-26 17:02:45,793::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720953::DEBUG::2014-06-26 17:02:45,794::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720953::DEBUG::2014-06-26 17:02:45,794::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720953::DEBUG::2014-06-26 17:02:45,794::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720953::DEBUG::2014-06-26 17:02:45,794::task::993::Storage.TaskManager.Task::(_decref) Task=`a0f08516-68f2-46bb-9aa5-fea2d42c2c9f`::ref 0 aborting False >Thread-720953::DEBUG::2014-06-26 17:02:45,794::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:46,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:46,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011899 s, 86.1 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:02:47,072::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:02:47,079::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.00036949 s, 1.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:47,565::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:47,565::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:47,565::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:47,565::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:47,566::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:47,566::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:47,566::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720954::DEBUG::2014-06-26 17:02:47,566::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720954::DEBUG::2014-06-26 17:02:47,567::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:48,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:48,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119085 s, 86.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:50,578::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:50,578::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:50,578::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:50,578::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:50,578::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:50,578::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720955::DEBUG::2014-06-26 17:02:50,579::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:02:50,579::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720955::DEBUG::2014-06-26 17:02:50,580::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf15862c-4553-4007-b120-ab9fad929286`::moving from state init -> state preparing >Thread-720955::INFO::2014-06-26 17:02:50,580::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-720955::INFO::2014-06-26 17:02:50,581::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00036949', 'lastCheck': '3.5', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000258925', 'lastCheck': '6.3', 'valid': True}} >Thread-720955::DEBUG::2014-06-26 17:02:50,581::task::1191::Storage.TaskManager.Task::(prepare) Task=`bf15862c-4553-4007-b120-ab9fad929286`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00036949', 'lastCheck': '3.5', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000258925', 'lastCheck': '6.3', 'valid': True}} >Thread-720955::DEBUG::2014-06-26 17:02:50,581::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf15862c-4553-4007-b120-ab9fad929286`::moving from state preparing -> state finished >Thread-720955::DEBUG::2014-06-26 17:02:50,581::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720955::DEBUG::2014-06-26 17:02:50,581::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720955::DEBUG::2014-06-26 17:02:50,581::task::993::Storage.TaskManager.Task::(_decref) Task=`bf15862c-4553-4007-b120-ab9fad929286`::ref 0 aborting False >Thread-720955::DEBUG::2014-06-26 17:02:50,583::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:50,617::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:50,617::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:50,617::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:50,617::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:50,617::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:50,618::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:50,618::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720956::DEBUG::2014-06-26 17:02:50,618::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-720956::DEBUG::2014-06-26 17:02:50,619::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:50,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:50,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117483 s, 87.2 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:02:52,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:53,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118832 s, 86.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:53,652::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:53,652::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:53,652::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:53,652::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:53,652::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:53,653::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:53,653::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720957::DEBUG::2014-06-26 17:02:53,653::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720957::DEBUG::2014-06-26 17:02:53,654::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:02:54,297::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:02:54,304::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000248015 s, 2.3 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:02:55,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:55,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115379 s, 88.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:55,818::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:55,819::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:55,819::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:55,819::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:55,819::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:55,819::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:55,820::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720958::DEBUG::2014-06-26 17:02:55,820::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-720958::DEBUG::2014-06-26 17:02:55,821::task::595::Storage.TaskManager.Task::(_updateState) Task=`094ebf2c-3c9a-4468-a8a1-9bb25289a784`::moving from state init -> state preparing >Thread-720958::INFO::2014-06-26 17:02:55,821::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720958::INFO::2014-06-26 17:02:55,821::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720958::DEBUG::2014-06-26 17:02:55,821::task::1191::Storage.TaskManager.Task::(prepare) Task=`094ebf2c-3c9a-4468-a8a1-9bb25289a784`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720958::DEBUG::2014-06-26 17:02:55,821::task::595::Storage.TaskManager.Task::(_updateState) Task=`094ebf2c-3c9a-4468-a8a1-9bb25289a784`::moving from state preparing -> state finished >Thread-720958::DEBUG::2014-06-26 17:02:55,821::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720958::DEBUG::2014-06-26 17:02:55,822::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720958::DEBUG::2014-06-26 17:02:55,822::task::993::Storage.TaskManager.Task::(_decref) Task=`094ebf2c-3c9a-4468-a8a1-9bb25289a784`::ref 0 aborting False >Thread-720958::DEBUG::2014-06-26 17:02:55,822::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:55,836::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:55,836::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:55,836::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:55,836::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:55,836::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:55,836::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:02:55,837::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720959::DEBUG::2014-06-26 17:02:55,837::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-720959::DEBUG::2014-06-26 17:02:55,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa0b28b6-0d96-49d8-8867-c5da74550624`::moving from state init -> state preparing >Thread-720959::INFO::2014-06-26 17:02:55,837::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720959::DEBUG::2014-06-26 17:02:55,838::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`4873d7c8-30d5-47d6-b243-da8cafb11367`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720959::DEBUG::2014-06-26 17:02:55,838::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720959::DEBUG::2014-06-26 17:02:55,838::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720959::DEBUG::2014-06-26 17:02:55,838::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`4873d7c8-30d5-47d6-b243-da8cafb11367`::Granted request >Thread-720959::DEBUG::2014-06-26 17:02:55,838::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fa0b28b6-0d96-49d8-8867-c5da74550624`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720959::DEBUG::2014-06-26 17:02:55,838::task::993::Storage.TaskManager.Task::(_decref) Task=`fa0b28b6-0d96-49d8-8867-c5da74550624`::ref 1 aborting False >Thread-720959::INFO::2014-06-26 17:02:55,841::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720959::DEBUG::2014-06-26 17:02:55,841::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa0b28b6-0d96-49d8-8867-c5da74550624`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720959::DEBUG::2014-06-26 17:02:55,841::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa0b28b6-0d96-49d8-8867-c5da74550624`::moving from state preparing -> state finished >Thread-720959::DEBUG::2014-06-26 17:02:55,841::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720959::DEBUG::2014-06-26 17:02:55,841::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720959::DEBUG::2014-06-26 17:02:55,841::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720959::DEBUG::2014-06-26 17:02:55,841::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720959::DEBUG::2014-06-26 17:02:55,841::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720959::DEBUG::2014-06-26 17:02:55,841::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720959::DEBUG::2014-06-26 17:02:55,842::task::993::Storage.TaskManager.Task::(_decref) Task=`fa0b28b6-0d96-49d8-8867-c5da74550624`::ref 0 aborting False >Thread-720959::DEBUG::2014-06-26 17:02:55,842::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:56,665::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:56,665::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:56,665::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:56,665::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:56,665::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:56,666::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720960::DEBUG::2014-06-26 17:02:56,666::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:02:56,666::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720960::DEBUG::2014-06-26 17:02:56,667::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:02:57,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:02:57,081::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:02:57,089::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000480525 s, 818 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:02:57,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130186 s, 78.7 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:02:59,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:02:59,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011827 s, 86.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:59,678::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:59,678::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:59,678::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:02:59,678::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:02:59,678::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:02:59,678::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720961::DEBUG::2014-06-26 17:02:59,679::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:02:59,679::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720961::DEBUG::2014-06-26 17:02:59,680::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:03:01,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:01,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119241 s, 85.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:02,694::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:02,694::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:02,694::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:02,694::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:02,694::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:02,695::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:02,695::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720962::DEBUG::2014-06-26 17:03:02,695::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720962::DEBUG::2014-06-26 17:03:02,696::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:03:03,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:03,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118167 s, 86.7 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:03:04,306::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:03:04,312::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000288264 s, 1.9 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:03:05,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:05,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119482 s, 85.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:05,707::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:05,707::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:05,707::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:05,708::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:05,708::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:05,708::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:05,708::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720963::DEBUG::2014-06-26 17:03:05,708::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-720963::DEBUG::2014-06-26 17:03:05,710::task::595::Storage.TaskManager.Task::(_updateState) Task=`d90e2ee5-ee74-4f0f-832e-d96744f20984`::moving from state init -> state preparing >Thread-720963::INFO::2014-06-26 17:03:05,710::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-720963::INFO::2014-06-26 17:03:05,710::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000480525', 'lastCheck': '8.6', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000288264', 'lastCheck': '1.4', 'valid': True}} >Thread-720963::DEBUG::2014-06-26 17:03:05,710::task::1191::Storage.TaskManager.Task::(prepare) Task=`d90e2ee5-ee74-4f0f-832e-d96744f20984`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000480525', 'lastCheck': '8.6', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000288264', 'lastCheck': '1.4', 'valid': True}} >Thread-720963::DEBUG::2014-06-26 17:03:05,710::task::595::Storage.TaskManager.Task::(_updateState) Task=`d90e2ee5-ee74-4f0f-832e-d96744f20984`::moving from state preparing -> state finished >Thread-720963::DEBUG::2014-06-26 17:03:05,711::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720963::DEBUG::2014-06-26 17:03:05,711::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720963::DEBUG::2014-06-26 17:03:05,711::task::993::Storage.TaskManager.Task::(_decref) Task=`d90e2ee5-ee74-4f0f-832e-d96744f20984`::ref 0 aborting False >Thread-720963::DEBUG::2014-06-26 17:03:05,713::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:05,747::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:05,747::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:05,748::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:05,748::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:05,748::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:05,748::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:05,748::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720964::DEBUG::2014-06-26 17:03:05,748::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-720964::DEBUG::2014-06-26 17:03:05,749::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:05,866::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:05,866::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:05,866::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:05,866::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:05,866::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:05,867::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720965::DEBUG::2014-06-26 17:03:05,867::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:03:05,867::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720965::DEBUG::2014-06-26 17:03:05,868::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c4eae29-955a-4308-afc0-354dbe1a7a96`::moving from state init -> state preparing >Thread-720965::INFO::2014-06-26 17:03:05,868::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720965::INFO::2014-06-26 17:03:05,868::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720965::DEBUG::2014-06-26 17:03:05,868::task::1191::Storage.TaskManager.Task::(prepare) Task=`0c4eae29-955a-4308-afc0-354dbe1a7a96`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720965::DEBUG::2014-06-26 17:03:05,868::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c4eae29-955a-4308-afc0-354dbe1a7a96`::moving from state preparing -> state finished >Thread-720965::DEBUG::2014-06-26 17:03:05,869::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720965::DEBUG::2014-06-26 17:03:05,869::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720965::DEBUG::2014-06-26 17:03:05,869::task::993::Storage.TaskManager.Task::(_decref) Task=`0c4eae29-955a-4308-afc0-354dbe1a7a96`::ref 0 aborting False >Thread-720965::DEBUG::2014-06-26 17:03:05,869::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:05,882::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:05,883::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:05,883::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:05,883::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:05,883::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:05,883::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720966::DEBUG::2014-06-26 17:03:05,884::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:03:05,884::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720966::DEBUG::2014-06-26 17:03:05,885::task::595::Storage.TaskManager.Task::(_updateState) Task=`53b8b9fd-41f8-46de-9142-2aed958e98c7`::moving from state init -> state preparing >Thread-720966::INFO::2014-06-26 17:03:05,886::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720966::DEBUG::2014-06-26 17:03:05,886::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`a72ebf64-f7bc-4eae-8833-4175038ec169`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720966::DEBUG::2014-06-26 17:03:05,886::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720966::DEBUG::2014-06-26 17:03:05,886::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720966::DEBUG::2014-06-26 17:03:05,886::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`a72ebf64-f7bc-4eae-8833-4175038ec169`::Granted request >Thread-720966::DEBUG::2014-06-26 17:03:05,887::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`53b8b9fd-41f8-46de-9142-2aed958e98c7`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720966::DEBUG::2014-06-26 17:03:05,887::task::993::Storage.TaskManager.Task::(_decref) Task=`53b8b9fd-41f8-46de-9142-2aed958e98c7`::ref 1 aborting False >Thread-720966::INFO::2014-06-26 17:03:05,889::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720966::DEBUG::2014-06-26 17:03:05,889::task::1191::Storage.TaskManager.Task::(prepare) Task=`53b8b9fd-41f8-46de-9142-2aed958e98c7`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720966::DEBUG::2014-06-26 17:03:05,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`53b8b9fd-41f8-46de-9142-2aed958e98c7`::moving from state preparing -> state finished >Thread-720966::DEBUG::2014-06-26 17:03:05,889::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720966::DEBUG::2014-06-26 17:03:05,890::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720966::DEBUG::2014-06-26 17:03:05,890::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720966::DEBUG::2014-06-26 17:03:05,890::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720966::DEBUG::2014-06-26 17:03:05,890::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720966::DEBUG::2014-06-26 17:03:05,890::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720966::DEBUG::2014-06-26 17:03:05,890::task::993::Storage.TaskManager.Task::(_decref) Task=`53b8b9fd-41f8-46de-9142-2aed958e98c7`::ref 0 aborting False >Thread-720966::DEBUG::2014-06-26 17:03:05,891::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:03:07,094::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:03:07,102::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000407513 s, 964 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:03:07,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:07,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0202466 s, 50.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:08,785::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:08,785::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:08,785::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:08,785::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:08,786::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:08,786::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:08,786::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720967::DEBUG::2014-06-26 17:03:08,786::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720967::DEBUG::2014-06-26 17:03:08,787::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:03:09,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:09,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119235 s, 85.9 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:03:11,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:11,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011754 s, 87.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:11,797::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:11,797::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:11,797::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:11,797::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:11,797::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:11,797::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:11,798::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720968::DEBUG::2014-06-26 17:03:11,798::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720968::DEBUG::2014-06-26 17:03:11,799::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:03:13,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:13,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115603 s, 88.6 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:03:14,315::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:03:14,321::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000229338 s, 2.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:14,809::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:14,810::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:14,810::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:14,810::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:14,810::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:14,810::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:14,811::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720969::DEBUG::2014-06-26 17:03:14,811::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720969::DEBUG::2014-06-26 17:03:14,812::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:03:15,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:15,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119219 s, 85.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:15,915::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:15,915::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:15,915::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:15,915::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:15,915::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:15,915::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:15,916::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720970::DEBUG::2014-06-26 17:03:15,916::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-720970::DEBUG::2014-06-26 17:03:15,917::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e6d40d1-401e-40b7-b14c-27800346d17d`::moving from state init -> state preparing >Thread-720970::INFO::2014-06-26 17:03:15,917::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720970::INFO::2014-06-26 17:03:15,917::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720970::DEBUG::2014-06-26 17:03:15,918::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e6d40d1-401e-40b7-b14c-27800346d17d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720970::DEBUG::2014-06-26 17:03:15,918::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e6d40d1-401e-40b7-b14c-27800346d17d`::moving from state preparing -> state finished >Thread-720970::DEBUG::2014-06-26 17:03:15,918::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720970::DEBUG::2014-06-26 17:03:15,918::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720970::DEBUG::2014-06-26 17:03:15,918::task::993::Storage.TaskManager.Task::(_decref) Task=`3e6d40d1-401e-40b7-b14c-27800346d17d`::ref 0 aborting False >Thread-720970::DEBUG::2014-06-26 17:03:15,918::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:15,938::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:15,938::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:15,938::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:15,938::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:15,938::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:15,938::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:15,939::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720971::DEBUG::2014-06-26 17:03:15,939::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-720971::DEBUG::2014-06-26 17:03:15,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ef975dc-39e6-4a01-b042-c2e0be99692d`::moving from state init -> state preparing >Thread-720971::INFO::2014-06-26 17:03:15,940::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720971::DEBUG::2014-06-26 17:03:15,940::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`542623a0-cde2-4744-ad4c-5a9f0d32aad2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720971::DEBUG::2014-06-26 17:03:15,940::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720971::DEBUG::2014-06-26 17:03:15,940::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720971::DEBUG::2014-06-26 17:03:15,940::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`542623a0-cde2-4744-ad4c-5a9f0d32aad2`::Granted request >Thread-720971::DEBUG::2014-06-26 17:03:15,941::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7ef975dc-39e6-4a01-b042-c2e0be99692d`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720971::DEBUG::2014-06-26 17:03:15,941::task::993::Storage.TaskManager.Task::(_decref) Task=`7ef975dc-39e6-4a01-b042-c2e0be99692d`::ref 1 aborting False >Thread-720971::INFO::2014-06-26 17:03:15,944::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720971::DEBUG::2014-06-26 17:03:15,944::task::1191::Storage.TaskManager.Task::(prepare) Task=`7ef975dc-39e6-4a01-b042-c2e0be99692d`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720971::DEBUG::2014-06-26 17:03:15,944::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ef975dc-39e6-4a01-b042-c2e0be99692d`::moving from state preparing -> state finished >Thread-720971::DEBUG::2014-06-26 17:03:15,944::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720971::DEBUG::2014-06-26 17:03:15,944::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720971::DEBUG::2014-06-26 17:03:15,944::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720971::DEBUG::2014-06-26 17:03:15,944::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720971::DEBUG::2014-06-26 17:03:15,944::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720971::DEBUG::2014-06-26 17:03:15,944::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720971::DEBUG::2014-06-26 17:03:15,945::task::993::Storage.TaskManager.Task::(_decref) Task=`7ef975dc-39e6-4a01-b042-c2e0be99692d`::ref 0 aborting False >Thread-720971::DEBUG::2014-06-26 17:03:15,945::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:03:17,106::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:03:17,114::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.00053971 s, 728 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:03:17,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:17,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118429 s, 86.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:17,821::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:17,821::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:17,821::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:17,821::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:17,822::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:17,822::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720972::DEBUG::2014-06-26 17:03:17,822::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:03:17,822::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720972::DEBUG::2014-06-26 17:03:17,824::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:03:19,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:19,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116657 s, 87.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:20,836::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:20,836::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:20,836::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:20,836::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:20,837::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:20,837::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:20,837::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720973::DEBUG::2014-06-26 17:03:20,837::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-720973::DEBUG::2014-06-26 17:03:20,839::task::595::Storage.TaskManager.Task::(_updateState) Task=`30cc0d7f-50b5-4e26-ad42-0ae8de1a4f66`::moving from state init -> state preparing >Thread-720973::INFO::2014-06-26 17:03:20,839::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-720973::INFO::2014-06-26 17:03:20,839::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00053971', 'lastCheck': '3.7', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000229338', 'lastCheck': '6.5', 'valid': True}} >Thread-720973::DEBUG::2014-06-26 17:03:20,839::task::1191::Storage.TaskManager.Task::(prepare) Task=`30cc0d7f-50b5-4e26-ad42-0ae8de1a4f66`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00053971', 'lastCheck': '3.7', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000229338', 'lastCheck': '6.5', 'valid': True}} >Thread-720973::DEBUG::2014-06-26 17:03:20,839::task::595::Storage.TaskManager.Task::(_updateState) Task=`30cc0d7f-50b5-4e26-ad42-0ae8de1a4f66`::moving from state preparing -> state finished >Thread-720973::DEBUG::2014-06-26 17:03:20,839::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720973::DEBUG::2014-06-26 17:03:20,839::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720973::DEBUG::2014-06-26 17:03:20,839::task::993::Storage.TaskManager.Task::(_decref) Task=`30cc0d7f-50b5-4e26-ad42-0ae8de1a4f66`::ref 0 aborting False >Thread-720973::DEBUG::2014-06-26 17:03:20,841::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:20,872::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:20,872::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:20,873::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:20,873::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:20,873::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:20,873::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:20,873::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720974::DEBUG::2014-06-26 17:03:20,873::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-720974::DEBUG::2014-06-26 17:03:20,874::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:03:21,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:21,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118515 s, 86.4 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:03:23,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:23,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0155465 s, 65.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:23,914::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:23,914::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:23,915::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:23,915::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:23,915::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:23,915::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:23,916::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720975::DEBUG::2014-06-26 17:03:23,916::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720975::DEBUG::2014-06-26 17:03:23,917::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:03:24,324::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:03:24,331::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000232619 s, 2.4 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:03:25,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:25,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118232 s, 86.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:25,970::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:25,970::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:25,971::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:25,971::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:25,971::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:25,971::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:25,972::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720976::DEBUG::2014-06-26 17:03:25,972::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-720976::DEBUG::2014-06-26 17:03:25,973::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fbd580b-fa64-4162-9bec-a51a7d461faa`::moving from state init -> state preparing >Thread-720976::INFO::2014-06-26 17:03:25,973::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720976::INFO::2014-06-26 17:03:25,973::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720976::DEBUG::2014-06-26 17:03:25,973::task::1191::Storage.TaskManager.Task::(prepare) Task=`7fbd580b-fa64-4162-9bec-a51a7d461faa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720976::DEBUG::2014-06-26 17:03:25,973::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fbd580b-fa64-4162-9bec-a51a7d461faa`::moving from state preparing -> state finished >Thread-720976::DEBUG::2014-06-26 17:03:25,973::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720976::DEBUG::2014-06-26 17:03:25,973::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720976::DEBUG::2014-06-26 17:03:25,974::task::993::Storage.TaskManager.Task::(_decref) Task=`7fbd580b-fa64-4162-9bec-a51a7d461faa`::ref 0 aborting False >Thread-720976::DEBUG::2014-06-26 17:03:25,974::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:25,990::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:25,990::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:25,990::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:25,990::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:25,990::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:25,990::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720977::DEBUG::2014-06-26 17:03:25,991::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:03:25,991::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720977::DEBUG::2014-06-26 17:03:25,992::task::595::Storage.TaskManager.Task::(_updateState) Task=`081879a2-0852-4675-8658-be58e68a965a`::moving from state init -> state preparing >Thread-720977::INFO::2014-06-26 17:03:25,992::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720977::DEBUG::2014-06-26 17:03:25,992::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`9476743d-e816-4c88-88fc-69845bdbb295`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720977::DEBUG::2014-06-26 17:03:25,992::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720977::DEBUG::2014-06-26 17:03:25,992::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720977::DEBUG::2014-06-26 17:03:25,992::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`9476743d-e816-4c88-88fc-69845bdbb295`::Granted request >Thread-720977::DEBUG::2014-06-26 17:03:25,993::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`081879a2-0852-4675-8658-be58e68a965a`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720977::DEBUG::2014-06-26 17:03:25,993::task::993::Storage.TaskManager.Task::(_decref) Task=`081879a2-0852-4675-8658-be58e68a965a`::ref 1 aborting False >Thread-720977::INFO::2014-06-26 17:03:25,995::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720977::DEBUG::2014-06-26 17:03:25,995::task::1191::Storage.TaskManager.Task::(prepare) Task=`081879a2-0852-4675-8658-be58e68a965a`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720977::DEBUG::2014-06-26 17:03:25,995::task::595::Storage.TaskManager.Task::(_updateState) Task=`081879a2-0852-4675-8658-be58e68a965a`::moving from state preparing -> state finished >Thread-720977::DEBUG::2014-06-26 17:03:25,995::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720977::DEBUG::2014-06-26 17:03:25,995::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720977::DEBUG::2014-06-26 17:03:25,995::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720977::DEBUG::2014-06-26 17:03:25,996::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720977::DEBUG::2014-06-26 17:03:25,996::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720977::DEBUG::2014-06-26 17:03:25,996::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720977::DEBUG::2014-06-26 17:03:25,996::task::993::Storage.TaskManager.Task::(_decref) Task=`081879a2-0852-4675-8658-be58e68a965a`::ref 0 aborting False >Thread-720977::DEBUG::2014-06-26 17:03:25,996::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:26,932::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:26,932::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:26,932::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:26,932::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:26,932::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:26,933::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720978::DEBUG::2014-06-26 17:03:26,933::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:03:26,933::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720978::DEBUG::2014-06-26 17:03:26,934::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:03:27,116::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:03:27,124::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.00050306 s, 781 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:03:27,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:27,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115832 s, 88.4 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:03:29,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:29,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117143 s, 87.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:29,945::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:29,945::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:29,945::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:29,946::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:29,946::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:29,947::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:29,948::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720979::DEBUG::2014-06-26 17:03:29,948::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720979::DEBUG::2014-06-26 17:03:29,951::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:03:31,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:32,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120226 s, 85.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:32,963::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:32,963::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:32,963::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:32,963::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:32,964::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:32,964::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:32,964::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720980::DEBUG::2014-06-26 17:03:32,964::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720980::DEBUG::2014-06-26 17:03:32,965::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:03:34,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:34,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0138223 s, 74.1 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:03:34,333::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:03:34,340::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000258723 s, 2.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:35,976::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:35,976::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:35,976::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:35,976::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:35,976::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:35,977::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:35,977::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720981::DEBUG::2014-06-26 17:03:35,977::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-720981::DEBUG::2014-06-26 17:03:35,978::task::595::Storage.TaskManager.Task::(_updateState) Task=`24bfd679-a5d5-489c-b0a5-fd7e5996a5f4`::moving from state init -> state preparing >Thread-720981::INFO::2014-06-26 17:03:35,979::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-720981::INFO::2014-06-26 17:03:35,979::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00050306', 'lastCheck': '8.9', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000258723', 'lastCheck': '1.6', 'valid': True}} >Thread-720981::DEBUG::2014-06-26 17:03:35,979::task::1191::Storage.TaskManager.Task::(prepare) Task=`24bfd679-a5d5-489c-b0a5-fd7e5996a5f4`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00050306', 'lastCheck': '8.9', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000258723', 'lastCheck': '1.6', 'valid': True}} >Thread-720981::DEBUG::2014-06-26 17:03:35,979::task::595::Storage.TaskManager.Task::(_updateState) Task=`24bfd679-a5d5-489c-b0a5-fd7e5996a5f4`::moving from state preparing -> state finished >Thread-720981::DEBUG::2014-06-26 17:03:35,979::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720981::DEBUG::2014-06-26 17:03:35,979::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720981::DEBUG::2014-06-26 17:03:35,979::task::993::Storage.TaskManager.Task::(_decref) Task=`24bfd679-a5d5-489c-b0a5-fd7e5996a5f4`::ref 0 aborting False >Thread-720981::DEBUG::2014-06-26 17:03:35,981::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:36,017::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:36,018::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:36,018::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:36,018::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:36,018::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:36,018::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:36,019::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720982::DEBUG::2014-06-26 17:03:36,019::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-720982::DEBUG::2014-06-26 17:03:36,019::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:36,021::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:36,021::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:36,021::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:36,021::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:36,021::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:36,022::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720983::DEBUG::2014-06-26 17:03:36,022::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:03:36,022::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720983::DEBUG::2014-06-26 17:03:36,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`c209173b-a239-4ce3-aa21-dc1e6e15461c`::moving from state init -> state preparing >Thread-720983::INFO::2014-06-26 17:03:36,023::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720983::INFO::2014-06-26 17:03:36,023::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720983::DEBUG::2014-06-26 17:03:36,023::task::1191::Storage.TaskManager.Task::(prepare) Task=`c209173b-a239-4ce3-aa21-dc1e6e15461c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720983::DEBUG::2014-06-26 17:03:36,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`c209173b-a239-4ce3-aa21-dc1e6e15461c`::moving from state preparing -> state finished >Thread-720983::DEBUG::2014-06-26 17:03:36,023::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720983::DEBUG::2014-06-26 17:03:36,024::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720983::DEBUG::2014-06-26 17:03:36,024::task::993::Storage.TaskManager.Task::(_decref) Task=`c209173b-a239-4ce3-aa21-dc1e6e15461c`::ref 0 aborting False >Thread-720983::DEBUG::2014-06-26 17:03:36,024::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:36,039::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:36,039::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:36,039::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:36,039::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:36,039::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:36,039::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:36,040::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720984::DEBUG::2014-06-26 17:03:36,040::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-720984::DEBUG::2014-06-26 17:03:36,040::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f098ff0-77f6-4ae4-8a44-ba72a87fae3e`::moving from state init -> state preparing >Thread-720984::INFO::2014-06-26 17:03:36,040::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720984::DEBUG::2014-06-26 17:03:36,041::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`9a48c6e1-89cc-4377-be4f-bba60054e3b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720984::DEBUG::2014-06-26 17:03:36,041::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720984::DEBUG::2014-06-26 17:03:36,041::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720984::DEBUG::2014-06-26 17:03:36,041::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`9a48c6e1-89cc-4377-be4f-bba60054e3b8`::Granted request >Thread-720984::DEBUG::2014-06-26 17:03:36,041::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4f098ff0-77f6-4ae4-8a44-ba72a87fae3e`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720984::DEBUG::2014-06-26 17:03:36,041::task::993::Storage.TaskManager.Task::(_decref) Task=`4f098ff0-77f6-4ae4-8a44-ba72a87fae3e`::ref 1 aborting False >Thread-720984::INFO::2014-06-26 17:03:36,044::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720984::DEBUG::2014-06-26 17:03:36,044::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f098ff0-77f6-4ae4-8a44-ba72a87fae3e`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720984::DEBUG::2014-06-26 17:03:36,044::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f098ff0-77f6-4ae4-8a44-ba72a87fae3e`::moving from state preparing -> state finished >Thread-720984::DEBUG::2014-06-26 17:03:36,044::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720984::DEBUG::2014-06-26 17:03:36,044::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720984::DEBUG::2014-06-26 17:03:36,044::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720984::DEBUG::2014-06-26 17:03:36,044::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720984::DEBUG::2014-06-26 17:03:36,045::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720984::DEBUG::2014-06-26 17:03:36,045::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720984::DEBUG::2014-06-26 17:03:36,045::task::993::Storage.TaskManager.Task::(_decref) Task=`4f098ff0-77f6-4ae4-8a44-ba72a87fae3e`::ref 0 aborting False >Thread-720984::DEBUG::2014-06-26 17:03:36,045::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:03:36,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:36,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120557 s, 84.9 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:03:37,128::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:03:37,136::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000479696 s, 819 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:03:38,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:38,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119199 s, 85.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:39,056::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:39,056::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:39,056::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:39,057::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:39,057::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:39,057::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720985::DEBUG::2014-06-26 17:03:39,058::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:03:39,058::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720985::DEBUG::2014-06-26 17:03:39,059::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:03:40,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:40,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118756 s, 86.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:42,070::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:42,070::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:42,070::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:42,070::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:42,070::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:42,071::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:42,071::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720986::DEBUG::2014-06-26 17:03:42,071::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720986::DEBUG::2014-06-26 17:03:42,072::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:03:42,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:42,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116444 s, 87.9 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:03:44,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:44,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116221 s, 88.1 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:03:44,342::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:03:44,349::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000261773 s, 2.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:45,085::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:45,085::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:45,085::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:45,085::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:45,085::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:45,086::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:45,086::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720987::DEBUG::2014-06-26 17:03:45,086::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720987::DEBUG::2014-06-26 17:03:45,087::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:46,077::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:46,078::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:46,078::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:46,078::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:46,078::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:46,078::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:46,079::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720988::DEBUG::2014-06-26 17:03:46,079::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-720988::DEBUG::2014-06-26 17:03:46,079::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a15b32d-f569-437e-b770-1008f575e5d8`::moving from state init -> state preparing >Thread-720988::INFO::2014-06-26 17:03:46,080::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720988::INFO::2014-06-26 17:03:46,080::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720988::DEBUG::2014-06-26 17:03:46,080::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a15b32d-f569-437e-b770-1008f575e5d8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720988::DEBUG::2014-06-26 17:03:46,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a15b32d-f569-437e-b770-1008f575e5d8`::moving from state preparing -> state finished >Thread-720988::DEBUG::2014-06-26 17:03:46,080::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720988::DEBUG::2014-06-26 17:03:46,080::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720988::DEBUG::2014-06-26 17:03:46,080::task::993::Storage.TaskManager.Task::(_decref) Task=`3a15b32d-f569-437e-b770-1008f575e5d8`::ref 0 aborting False >Thread-720988::DEBUG::2014-06-26 17:03:46,081::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:46,095::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:46,095::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:46,095::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:46,096::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:46,096::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:46,096::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720989::DEBUG::2014-06-26 17:03:46,096::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:03:46,096::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720989::DEBUG::2014-06-26 17:03:46,097::task::595::Storage.TaskManager.Task::(_updateState) Task=`4216239d-80e7-48ed-825c-694bc68f2df7`::moving from state init -> state preparing >Thread-720989::INFO::2014-06-26 17:03:46,097::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720989::DEBUG::2014-06-26 17:03:46,098::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`e747d929-7402-4eb1-a367-46c5175c58ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720989::DEBUG::2014-06-26 17:03:46,098::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720989::DEBUG::2014-06-26 17:03:46,098::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720989::DEBUG::2014-06-26 17:03:46,098::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`e747d929-7402-4eb1-a367-46c5175c58ec`::Granted request >Thread-720989::DEBUG::2014-06-26 17:03:46,098::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4216239d-80e7-48ed-825c-694bc68f2df7`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720989::DEBUG::2014-06-26 17:03:46,098::task::993::Storage.TaskManager.Task::(_decref) Task=`4216239d-80e7-48ed-825c-694bc68f2df7`::ref 1 aborting False >Thread-720989::INFO::2014-06-26 17:03:46,100::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720989::DEBUG::2014-06-26 17:03:46,101::task::1191::Storage.TaskManager.Task::(prepare) Task=`4216239d-80e7-48ed-825c-694bc68f2df7`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720989::DEBUG::2014-06-26 17:03:46,101::task::595::Storage.TaskManager.Task::(_updateState) Task=`4216239d-80e7-48ed-825c-694bc68f2df7`::moving from state preparing -> state finished >Thread-720989::DEBUG::2014-06-26 17:03:46,101::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720989::DEBUG::2014-06-26 17:03:46,101::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720989::DEBUG::2014-06-26 17:03:46,101::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720989::DEBUG::2014-06-26 17:03:46,101::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720989::DEBUG::2014-06-26 17:03:46,101::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720989::DEBUG::2014-06-26 17:03:46,101::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720989::DEBUG::2014-06-26 17:03:46,101::task::993::Storage.TaskManager.Task::(_decref) Task=`4216239d-80e7-48ed-825c-694bc68f2df7`::ref 0 aborting False >Thread-720989::DEBUG::2014-06-26 17:03:46,102::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:03:46,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:46,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011686 s, 87.6 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:03:47,139::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:03:47,146::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000427249 s, 920 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:48,100::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:48,100::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:48,100::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:48,100::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:48,101::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:48,101::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:48,101::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720990::DEBUG::2014-06-26 17:03:48,101::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720990::DEBUG::2014-06-26 17:03:48,102::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:03:48,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:48,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122369 s, 83.7 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:03:50,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:50,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117889 s, 86.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:51,115::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:51,115::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:51,116::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:51,116::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:51,116::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:51,116::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:51,117::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720991::DEBUG::2014-06-26 17:03:51,117::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-720991::DEBUG::2014-06-26 17:03:51,118::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ede52f3-6707-450e-985e-2d1554695d74`::moving from state init -> state preparing >Thread-720991::INFO::2014-06-26 17:03:51,118::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-720991::INFO::2014-06-26 17:03:51,118::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000427249', 'lastCheck': '4.0', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000261773', 'lastCheck': '6.8', 'valid': True}} >Thread-720991::DEBUG::2014-06-26 17:03:51,118::task::1191::Storage.TaskManager.Task::(prepare) Task=`1ede52f3-6707-450e-985e-2d1554695d74`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000427249', 'lastCheck': '4.0', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000261773', 'lastCheck': '6.8', 'valid': True}} >Thread-720991::DEBUG::2014-06-26 17:03:51,118::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ede52f3-6707-450e-985e-2d1554695d74`::moving from state preparing -> state finished >Thread-720991::DEBUG::2014-06-26 17:03:51,119::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720991::DEBUG::2014-06-26 17:03:51,119::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720991::DEBUG::2014-06-26 17:03:51,119::task::993::Storage.TaskManager.Task::(_decref) Task=`1ede52f3-6707-450e-985e-2d1554695d74`::ref 0 aborting False >Thread-720991::DEBUG::2014-06-26 17:03:51,121::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:51,154::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:51,155::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:51,155::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:51,155::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:51,155::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:51,155::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:51,155::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720992::DEBUG::2014-06-26 17:03:51,155::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-720992::DEBUG::2014-06-26 17:03:51,156::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:03:52,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:52,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011828 s, 86.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:54,188::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:54,188::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:54,188::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:54,188::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:54,188::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:54,188::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720993::DEBUG::2014-06-26 17:03:54,189::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:03:54,189::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720993::DEBUG::2014-06-26 17:03:54,190::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:03:54,352::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:03:54,358::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000279849 s, 2.0 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:03:54,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:54,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116239 s, 88.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:56,138::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:56,138::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:56,138::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:56,138::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:56,139::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:56,139::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:56,139::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720994::DEBUG::2014-06-26 17:03:56,139::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-720994::DEBUG::2014-06-26 17:03:56,140::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1ea4edc-47c7-4f2e-8d46-8b041a31d4bd`::moving from state init -> state preparing >Thread-720994::INFO::2014-06-26 17:03:56,140::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720994::INFO::2014-06-26 17:03:56,141::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720994::DEBUG::2014-06-26 17:03:56,141::task::1191::Storage.TaskManager.Task::(prepare) Task=`f1ea4edc-47c7-4f2e-8d46-8b041a31d4bd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720994::DEBUG::2014-06-26 17:03:56,141::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1ea4edc-47c7-4f2e-8d46-8b041a31d4bd`::moving from state preparing -> state finished >Thread-720994::DEBUG::2014-06-26 17:03:56,141::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720994::DEBUG::2014-06-26 17:03:56,141::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720994::DEBUG::2014-06-26 17:03:56,141::task::993::Storage.TaskManager.Task::(_decref) Task=`f1ea4edc-47c7-4f2e-8d46-8b041a31d4bd`::ref 0 aborting False >Thread-720994::DEBUG::2014-06-26 17:03:56,141::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:56,155::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:56,155::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:56,155::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:56,155::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:56,155::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:56,156::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:56,156::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720995::DEBUG::2014-06-26 17:03:56,156::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-720995::DEBUG::2014-06-26 17:03:56,157::task::595::Storage.TaskManager.Task::(_updateState) Task=`62ba1ffb-1b98-4890-a9db-49abba04138d`::moving from state init -> state preparing >Thread-720995::INFO::2014-06-26 17:03:56,157::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720995::DEBUG::2014-06-26 17:03:56,157::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`9ab53741-c8cc-494e-87bd-0798bc797e84`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-720995::DEBUG::2014-06-26 17:03:56,157::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-720995::DEBUG::2014-06-26 17:03:56,157::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-720995::DEBUG::2014-06-26 17:03:56,157::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`9ab53741-c8cc-494e-87bd-0798bc797e84`::Granted request >Thread-720995::DEBUG::2014-06-26 17:03:56,158::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`62ba1ffb-1b98-4890-a9db-49abba04138d`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-720995::DEBUG::2014-06-26 17:03:56,158::task::993::Storage.TaskManager.Task::(_decref) Task=`62ba1ffb-1b98-4890-a9db-49abba04138d`::ref 1 aborting False >Thread-720995::INFO::2014-06-26 17:03:56,160::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720995::DEBUG::2014-06-26 17:03:56,160::task::1191::Storage.TaskManager.Task::(prepare) Task=`62ba1ffb-1b98-4890-a9db-49abba04138d`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-720995::DEBUG::2014-06-26 17:03:56,160::task::595::Storage.TaskManager.Task::(_updateState) Task=`62ba1ffb-1b98-4890-a9db-49abba04138d`::moving from state preparing -> state finished >Thread-720995::DEBUG::2014-06-26 17:03:56,160::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-720995::DEBUG::2014-06-26 17:03:56,160::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720995::DEBUG::2014-06-26 17:03:56,160::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-720995::DEBUG::2014-06-26 17:03:56,161::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-720995::DEBUG::2014-06-26 17:03:56,161::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-720995::DEBUG::2014-06-26 17:03:56,161::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-720995::DEBUG::2014-06-26 17:03:56,161::task::993::Storage.TaskManager.Task::(_decref) Task=`62ba1ffb-1b98-4890-a9db-49abba04138d`::ref 0 aborting False >Thread-720995::DEBUG::2014-06-26 17:03:56,161::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:03:56,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:56,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116858 s, 87.6 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:03:57,152::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:03:57,159::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000459073 s, 856 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:57,200::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:57,200::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:57,201::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:03:57,201::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:03:57,201::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:03:57,201::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:03:57,202::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720996::DEBUG::2014-06-26 17:03:57,202::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720996::DEBUG::2014-06-26 17:03:57,203::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:03:58,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:03:58,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114541 s, 89.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:00,213::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:00,214::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:00,214::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:00,214::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:00,214::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:00,214::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:00,215::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720997::DEBUG::2014-06-26 17:04:00,215::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-720997::DEBUG::2014-06-26 17:04:00,216::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:00,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:00,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116559 s, 87.9 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:04:02,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:02,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128407 s, 79.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:03,227::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:03,227::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:03,227::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:03,227::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:03,227::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:03,228::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-720998::DEBUG::2014-06-26 17:04:03,228::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:04:03,228::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720998::DEBUG::2014-06-26 17:04:03,229::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:04:04,360::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:04:04,367::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000259049 s, 2.2 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:04:04,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:04,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120254 s, 85.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:06,185::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:06,186::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:06,186::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:06,186::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:06,186::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:06,186::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:06,187::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-720999::DEBUG::2014-06-26 17:04:06,187::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-720999::DEBUG::2014-06-26 17:04:06,188::task::595::Storage.TaskManager.Task::(_updateState) Task=`91d852a6-3eba-4acd-8344-f628e55e43b5`::moving from state init -> state preparing >Thread-720999::INFO::2014-06-26 17:04:06,188::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-720999::INFO::2014-06-26 17:04:06,188::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720999::DEBUG::2014-06-26 17:04:06,189::task::1191::Storage.TaskManager.Task::(prepare) Task=`91d852a6-3eba-4acd-8344-f628e55e43b5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-720999::DEBUG::2014-06-26 17:04:06,189::task::595::Storage.TaskManager.Task::(_updateState) Task=`91d852a6-3eba-4acd-8344-f628e55e43b5`::moving from state preparing -> state finished >Thread-720999::DEBUG::2014-06-26 17:04:06,189::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-720999::DEBUG::2014-06-26 17:04:06,189::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-720999::DEBUG::2014-06-26 17:04:06,189::task::993::Storage.TaskManager.Task::(_decref) Task=`91d852a6-3eba-4acd-8344-f628e55e43b5`::ref 0 aborting False >Thread-720999::DEBUG::2014-06-26 17:04:06,189::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:06,204::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:06,204::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:06,204::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:06,204::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:06,204::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:06,204::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:06,205::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721000::DEBUG::2014-06-26 17:04:06,205::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721000::DEBUG::2014-06-26 17:04:06,206::task::595::Storage.TaskManager.Task::(_updateState) Task=`7314d5d4-2770-49a6-8e2a-ef5fe8cf329c`::moving from state init -> state preparing >Thread-721000::INFO::2014-06-26 17:04:06,206::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721000::DEBUG::2014-06-26 17:04:06,206::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`601ed2ba-cf7a-4c39-b456-819df8bf99d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721000::DEBUG::2014-06-26 17:04:06,206::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721000::DEBUG::2014-06-26 17:04:06,206::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721000::DEBUG::2014-06-26 17:04:06,206::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`601ed2ba-cf7a-4c39-b456-819df8bf99d4`::Granted request >Thread-721000::DEBUG::2014-06-26 17:04:06,207::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7314d5d4-2770-49a6-8e2a-ef5fe8cf329c`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721000::DEBUG::2014-06-26 17:04:06,207::task::993::Storage.TaskManager.Task::(_decref) Task=`7314d5d4-2770-49a6-8e2a-ef5fe8cf329c`::ref 1 aborting False >Thread-721000::INFO::2014-06-26 17:04:06,209::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721000::DEBUG::2014-06-26 17:04:06,209::task::1191::Storage.TaskManager.Task::(prepare) Task=`7314d5d4-2770-49a6-8e2a-ef5fe8cf329c`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721000::DEBUG::2014-06-26 17:04:06,209::task::595::Storage.TaskManager.Task::(_updateState) Task=`7314d5d4-2770-49a6-8e2a-ef5fe8cf329c`::moving from state preparing -> state finished >Thread-721000::DEBUG::2014-06-26 17:04:06,209::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721000::DEBUG::2014-06-26 17:04:06,210::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721000::DEBUG::2014-06-26 17:04:06,210::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721000::DEBUG::2014-06-26 17:04:06,210::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721000::DEBUG::2014-06-26 17:04:06,210::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721000::DEBUG::2014-06-26 17:04:06,210::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721000::DEBUG::2014-06-26 17:04:06,210::task::993::Storage.TaskManager.Task::(_decref) Task=`7314d5d4-2770-49a6-8e2a-ef5fe8cf329c`::ref 0 aborting False >Thread-721000::DEBUG::2014-06-26 17:04:06,211::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:06,241::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:06,241::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:06,241::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:06,241::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:06,241::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:06,241::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721001::DEBUG::2014-06-26 17:04:06,242::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:04:06,242::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721001::DEBUG::2014-06-26 17:04:06,243::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c268b0c-5000-423d-b0f8-eab1d5676a2f`::moving from state init -> state preparing >Thread-721001::INFO::2014-06-26 17:04:06,243::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721001::INFO::2014-06-26 17:04:06,243::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000459073', 'lastCheck': '9.1', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259049', 'lastCheck': '1.9', 'valid': True}} >Thread-721001::DEBUG::2014-06-26 17:04:06,243::task::1191::Storage.TaskManager.Task::(prepare) Task=`1c268b0c-5000-423d-b0f8-eab1d5676a2f`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000459073', 'lastCheck': '9.1', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259049', 'lastCheck': '1.9', 'valid': True}} >Thread-721001::DEBUG::2014-06-26 17:04:06,243::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c268b0c-5000-423d-b0f8-eab1d5676a2f`::moving from state preparing -> state finished >Thread-721001::DEBUG::2014-06-26 17:04:06,244::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721001::DEBUG::2014-06-26 17:04:06,244::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721001::DEBUG::2014-06-26 17:04:06,244::task::993::Storage.TaskManager.Task::(_decref) Task=`1c268b0c-5000-423d-b0f8-eab1d5676a2f`::ref 0 aborting False >Thread-721001::DEBUG::2014-06-26 17:04:06,246::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:06,281::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:06,281::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:06,281::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:06,281::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:06,282::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:06,282::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:06,282::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721002::DEBUG::2014-06-26 17:04:06,282::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721002::DEBUG::2014-06-26 17:04:06,283::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:06,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:06,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173839 s, 58.9 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:04:07,163::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:04:07,171::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000532055 s, 739 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:04:08,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:08,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117679 s, 87.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:09,318::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:09,319::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:09,319::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:09,319::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:09,319::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:09,319::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721003::DEBUG::2014-06-26 17:04:09,320::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:04:09,320::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721003::DEBUG::2014-06-26 17:04:09,321::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:11,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:11,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118382 s, 86.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:12,336::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:12,337::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:12,337::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:12,337::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:12,337::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:12,337::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:12,338::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721004::DEBUG::2014-06-26 17:04:12,338::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721004::DEBUG::2014-06-26 17:04:12,339::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:13,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:13,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011872 s, 86.3 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:04:14,369::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:04:14,376::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.00028051 s, 2.0 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:04:15,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:15,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117356 s, 87.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:15,351::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:15,351::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:15,351::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:15,351::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:15,351::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:15,352::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:15,352::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721005::DEBUG::2014-06-26 17:04:15,352::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721005::DEBUG::2014-06-26 17:04:15,353::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:16,235::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:16,235::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:16,236::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:16,236::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:16,236::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:16,236::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721006::DEBUG::2014-06-26 17:04:16,236::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:04:16,237::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721006::DEBUG::2014-06-26 17:04:16,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`7409b4c7-9009-4d2f-aa70-13b0baba1a40`::moving from state init -> state preparing >Thread-721006::INFO::2014-06-26 17:04:16,238::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721006::INFO::2014-06-26 17:04:16,238::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721006::DEBUG::2014-06-26 17:04:16,238::task::1191::Storage.TaskManager.Task::(prepare) Task=`7409b4c7-9009-4d2f-aa70-13b0baba1a40`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721006::DEBUG::2014-06-26 17:04:16,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`7409b4c7-9009-4d2f-aa70-13b0baba1a40`::moving from state preparing -> state finished >Thread-721006::DEBUG::2014-06-26 17:04:16,238::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721006::DEBUG::2014-06-26 17:04:16,238::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721006::DEBUG::2014-06-26 17:04:16,238::task::993::Storage.TaskManager.Task::(_decref) Task=`7409b4c7-9009-4d2f-aa70-13b0baba1a40`::ref 0 aborting False >Thread-721006::DEBUG::2014-06-26 17:04:16,239::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:16,253::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:16,253::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:16,254::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:16,254::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:16,254::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:16,254::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:16,254::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721007::DEBUG::2014-06-26 17:04:16,254::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721007::DEBUG::2014-06-26 17:04:16,255::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7cab587-c7ec-4610-9645-d97cdf2ca29c`::moving from state init -> state preparing >Thread-721007::INFO::2014-06-26 17:04:16,255::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721007::DEBUG::2014-06-26 17:04:16,256::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`f37709ed-4d9a-4487-9df3-4c9c7f18a465`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721007::DEBUG::2014-06-26 17:04:16,256::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721007::DEBUG::2014-06-26 17:04:16,256::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721007::DEBUG::2014-06-26 17:04:16,256::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`f37709ed-4d9a-4487-9df3-4c9c7f18a465`::Granted request >Thread-721007::DEBUG::2014-06-26 17:04:16,256::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a7cab587-c7ec-4610-9645-d97cdf2ca29c`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721007::DEBUG::2014-06-26 17:04:16,256::task::993::Storage.TaskManager.Task::(_decref) Task=`a7cab587-c7ec-4610-9645-d97cdf2ca29c`::ref 1 aborting False >Thread-721007::INFO::2014-06-26 17:04:16,258::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721007::DEBUG::2014-06-26 17:04:16,259::task::1191::Storage.TaskManager.Task::(prepare) Task=`a7cab587-c7ec-4610-9645-d97cdf2ca29c`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721007::DEBUG::2014-06-26 17:04:16,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7cab587-c7ec-4610-9645-d97cdf2ca29c`::moving from state preparing -> state finished >Thread-721007::DEBUG::2014-06-26 17:04:16,259::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721007::DEBUG::2014-06-26 17:04:16,259::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721007::DEBUG::2014-06-26 17:04:16,259::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721007::DEBUG::2014-06-26 17:04:16,259::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721007::DEBUG::2014-06-26 17:04:16,259::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721007::DEBUG::2014-06-26 17:04:16,259::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721007::DEBUG::2014-06-26 17:04:16,259::task::993::Storage.TaskManager.Task::(_decref) Task=`a7cab587-c7ec-4610-9645-d97cdf2ca29c`::ref 0 aborting False >Thread-721007::DEBUG::2014-06-26 17:04:16,260::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:17,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:04:17,175::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:04:17,182::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000492373 s, 798 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:04:17,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170912 s, 59.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:18,365::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:18,365::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:18,365::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:18,365::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:18,366::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:18,366::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:18,367::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721008::DEBUG::2014-06-26 17:04:18,367::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721008::DEBUG::2014-06-26 17:04:18,368::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:19,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:19,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118506 s, 86.4 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:04:21,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:21,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117585 s, 87.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:21,378::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:21,379::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:21,379::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:21,379::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:21,379::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:21,379::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721009::DEBUG::2014-06-26 17:04:21,380::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:04:21,380::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721009::DEBUG::2014-06-26 17:04:21,382::task::595::Storage.TaskManager.Task::(_updateState) Task=`26d37905-8a6b-44e9-ae32-d9faa93a43b1`::moving from state init -> state preparing >Thread-721009::INFO::2014-06-26 17:04:21,382::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721009::INFO::2014-06-26 17:04:21,382::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492373', 'lastCheck': '4.2', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00028051', 'lastCheck': '7.0', 'valid': True}} >Thread-721009::DEBUG::2014-06-26 17:04:21,382::task::1191::Storage.TaskManager.Task::(prepare) Task=`26d37905-8a6b-44e9-ae32-d9faa93a43b1`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492373', 'lastCheck': '4.2', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00028051', 'lastCheck': '7.0', 'valid': True}} >Thread-721009::DEBUG::2014-06-26 17:04:21,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`26d37905-8a6b-44e9-ae32-d9faa93a43b1`::moving from state preparing -> state finished >Thread-721009::DEBUG::2014-06-26 17:04:21,383::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721009::DEBUG::2014-06-26 17:04:21,383::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721009::DEBUG::2014-06-26 17:04:21,383::task::993::Storage.TaskManager.Task::(_decref) Task=`26d37905-8a6b-44e9-ae32-d9faa93a43b1`::ref 0 aborting False >Thread-721009::DEBUG::2014-06-26 17:04:21,385::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:21,426::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:21,427::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:21,427::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:21,427::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:21,427::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:21,427::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:21,427::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721010::DEBUG::2014-06-26 17:04:21,428::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721010::DEBUG::2014-06-26 17:04:21,428::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:23,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:23,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117489 s, 87.2 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:04:24,379::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:04:24,386::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000222454 s, 2.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:24,465::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:24,465::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:24,465::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:24,465::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:24,466::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:24,466::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:24,467::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721011::DEBUG::2014-06-26 17:04:24,467::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721011::DEBUG::2014-06-26 17:04:24,468::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:25,216::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:25,216::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:25,216::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:25,216::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:25,217::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:25,217::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:25,217::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721012::DEBUG::2014-06-26 17:04:25,217::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Volume_extendSize' in bridge >Thread-721012::DEBUG::2014-06-26 17:04:25,218::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:25,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:25,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117581 s, 87.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:26,285::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:26,285::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:26,286::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:26,286::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:26,286::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:26,286::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:26,287::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721013::DEBUG::2014-06-26 17:04:26,287::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721013::DEBUG::2014-06-26 17:04:26,288::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc6db1bc-5dab-4bd7-80d4-88418d212a80`::moving from state init -> state preparing >Thread-721013::INFO::2014-06-26 17:04:26,288::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721013::INFO::2014-06-26 17:04:26,288::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721013::DEBUG::2014-06-26 17:04:26,288::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc6db1bc-5dab-4bd7-80d4-88418d212a80`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721013::DEBUG::2014-06-26 17:04:26,288::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc6db1bc-5dab-4bd7-80d4-88418d212a80`::moving from state preparing -> state finished >Thread-721013::DEBUG::2014-06-26 17:04:26,288::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721013::DEBUG::2014-06-26 17:04:26,289::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721013::DEBUG::2014-06-26 17:04:26,289::task::993::Storage.TaskManager.Task::(_decref) Task=`cc6db1bc-5dab-4bd7-80d4-88418d212a80`::ref 0 aborting False >Thread-721013::DEBUG::2014-06-26 17:04:26,289::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:26,303::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:26,303::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:26,303::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:26,303::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:26,303::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:26,303::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:26,304::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721014::DEBUG::2014-06-26 17:04:26,304::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721014::DEBUG::2014-06-26 17:04:26,304::task::595::Storage.TaskManager.Task::(_updateState) Task=`b76d2f5b-7dfd-441d-8860-a8c5b535d105`::moving from state init -> state preparing >Thread-721014::INFO::2014-06-26 17:04:26,305::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721014::DEBUG::2014-06-26 17:04:26,305::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`f09fdaae-f5aa-4195-a136-728ffa271cfd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721014::DEBUG::2014-06-26 17:04:26,305::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721014::DEBUG::2014-06-26 17:04:26,305::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721014::DEBUG::2014-06-26 17:04:26,305::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`f09fdaae-f5aa-4195-a136-728ffa271cfd`::Granted request >Thread-721014::DEBUG::2014-06-26 17:04:26,305::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b76d2f5b-7dfd-441d-8860-a8c5b535d105`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721014::DEBUG::2014-06-26 17:04:26,306::task::993::Storage.TaskManager.Task::(_decref) Task=`b76d2f5b-7dfd-441d-8860-a8c5b535d105`::ref 1 aborting False >Thread-721014::INFO::2014-06-26 17:04:26,308::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721014::DEBUG::2014-06-26 17:04:26,308::task::1191::Storage.TaskManager.Task::(prepare) Task=`b76d2f5b-7dfd-441d-8860-a8c5b535d105`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721014::DEBUG::2014-06-26 17:04:26,308::task::595::Storage.TaskManager.Task::(_updateState) Task=`b76d2f5b-7dfd-441d-8860-a8c5b535d105`::moving from state preparing -> state finished >Thread-721014::DEBUG::2014-06-26 17:04:26,308::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721014::DEBUG::2014-06-26 17:04:26,308::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721014::DEBUG::2014-06-26 17:04:26,308::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721014::DEBUG::2014-06-26 17:04:26,308::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721014::DEBUG::2014-06-26 17:04:26,309::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721014::DEBUG::2014-06-26 17:04:26,309::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721014::DEBUG::2014-06-26 17:04:26,309::task::993::Storage.TaskManager.Task::(_decref) Task=`b76d2f5b-7dfd-441d-8860-a8c5b535d105`::ref 0 aborting False >Thread-721014::DEBUG::2014-06-26 17:04:26,309::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:04:27,186::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:04:27,194::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000564684 s, 696 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:04:27,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:27,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116441 s, 87.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:27,479::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:27,479::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:27,479::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:27,479::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:27,479::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:27,480::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:27,480::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721015::DEBUG::2014-06-26 17:04:27,480::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721015::DEBUG::2014-06-26 17:04:27,481::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:29,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:29,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119075 s, 86.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:30,493::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:30,493::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:30,493::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:30,493::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:30,493::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:30,493::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:30,494::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721016::DEBUG::2014-06-26 17:04:30,494::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721016::DEBUG::2014-06-26 17:04:30,495::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:31,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:31,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117115 s, 87.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:33,509::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:33,509::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:33,510::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:33,510::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:33,510::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:33,510::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:33,511::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721017::DEBUG::2014-06-26 17:04:33,511::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721017::DEBUG::2014-06-26 17:04:33,512::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:33,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:33,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121601 s, 84.2 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:04:34,388::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:04:34,397::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.00126139 s, 443 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:04:35,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:35,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121861 s, 84.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:36,332::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:36,333::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:36,333::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:36,333::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:36,333::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:36,333::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:36,334::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721018::DEBUG::2014-06-26 17:04:36,334::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721018::DEBUG::2014-06-26 17:04:36,335::task::595::Storage.TaskManager.Task::(_updateState) Task=`09287225-7809-4da3-bbfe-32f3b904b615`::moving from state init -> state preparing >Thread-721018::INFO::2014-06-26 17:04:36,335::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721018::INFO::2014-06-26 17:04:36,335::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721018::DEBUG::2014-06-26 17:04:36,336::task::1191::Storage.TaskManager.Task::(prepare) Task=`09287225-7809-4da3-bbfe-32f3b904b615`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721018::DEBUG::2014-06-26 17:04:36,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`09287225-7809-4da3-bbfe-32f3b904b615`::moving from state preparing -> state finished >Thread-721018::DEBUG::2014-06-26 17:04:36,336::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721018::DEBUG::2014-06-26 17:04:36,336::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721018::DEBUG::2014-06-26 17:04:36,336::task::993::Storage.TaskManager.Task::(_decref) Task=`09287225-7809-4da3-bbfe-32f3b904b615`::ref 0 aborting False >Thread-721018::DEBUG::2014-06-26 17:04:36,336::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:36,350::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:36,350::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:36,350::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:36,350::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:36,350::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:36,350::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:36,351::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721019::DEBUG::2014-06-26 17:04:36,351::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721019::DEBUG::2014-06-26 17:04:36,352::task::595::Storage.TaskManager.Task::(_updateState) Task=`a61a604c-0898-45c5-a46d-70ef398fda9a`::moving from state init -> state preparing >Thread-721019::INFO::2014-06-26 17:04:36,352::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721019::DEBUG::2014-06-26 17:04:36,352::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`c5f7e748-9dff-4c5a-8fdb-39097ba6e4c9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721019::DEBUG::2014-06-26 17:04:36,352::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721019::DEBUG::2014-06-26 17:04:36,352::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721019::DEBUG::2014-06-26 17:04:36,352::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`c5f7e748-9dff-4c5a-8fdb-39097ba6e4c9`::Granted request >Thread-721019::DEBUG::2014-06-26 17:04:36,353::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a61a604c-0898-45c5-a46d-70ef398fda9a`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721019::DEBUG::2014-06-26 17:04:36,353::task::993::Storage.TaskManager.Task::(_decref) Task=`a61a604c-0898-45c5-a46d-70ef398fda9a`::ref 1 aborting False >Thread-721019::INFO::2014-06-26 17:04:36,355::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721019::DEBUG::2014-06-26 17:04:36,355::task::1191::Storage.TaskManager.Task::(prepare) Task=`a61a604c-0898-45c5-a46d-70ef398fda9a`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721019::DEBUG::2014-06-26 17:04:36,355::task::595::Storage.TaskManager.Task::(_updateState) Task=`a61a604c-0898-45c5-a46d-70ef398fda9a`::moving from state preparing -> state finished >Thread-721019::DEBUG::2014-06-26 17:04:36,355::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721019::DEBUG::2014-06-26 17:04:36,355::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721019::DEBUG::2014-06-26 17:04:36,356::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721019::DEBUG::2014-06-26 17:04:36,356::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721019::DEBUG::2014-06-26 17:04:36,356::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721019::DEBUG::2014-06-26 17:04:36,356::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721019::DEBUG::2014-06-26 17:04:36,356::task::993::Storage.TaskManager.Task::(_decref) Task=`a61a604c-0898-45c5-a46d-70ef398fda9a`::ref 0 aborting False >Thread-721019::DEBUG::2014-06-26 17:04:36,357::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:36,525::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:36,525::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:36,526::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:36,526::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:36,527::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:36,527::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:36,529::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721020::DEBUG::2014-06-26 17:04:36,529::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721020::DEBUG::2014-06-26 17:04:36,533::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8a4cf2a-dd1e-4afd-b1c2-dfe57d5d04e0`::moving from state init -> state preparing >Thread-721020::INFO::2014-06-26 17:04:36,533::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721020::INFO::2014-06-26 17:04:36,534::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000564684', 'lastCheck': '9.3', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00126139', 'lastCheck': '2.1', 'valid': True}} >Thread-721020::DEBUG::2014-06-26 17:04:36,534::task::1191::Storage.TaskManager.Task::(prepare) Task=`d8a4cf2a-dd1e-4afd-b1c2-dfe57d5d04e0`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000564684', 'lastCheck': '9.3', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00126139', 'lastCheck': '2.1', 'valid': True}} >Thread-721020::DEBUG::2014-06-26 17:04:36,535::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8a4cf2a-dd1e-4afd-b1c2-dfe57d5d04e0`::moving from state preparing -> state finished >Thread-721020::DEBUG::2014-06-26 17:04:36,535::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721020::DEBUG::2014-06-26 17:04:36,535::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721020::DEBUG::2014-06-26 17:04:36,536::task::993::Storage.TaskManager.Task::(_decref) Task=`d8a4cf2a-dd1e-4afd-b1c2-dfe57d5d04e0`::ref 0 aborting False >Thread-721020::DEBUG::2014-06-26 17:04:36,550::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:36,584::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:36,584::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:36,585::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:36,585::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:36,586::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:36,586::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:36,588::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721021::DEBUG::2014-06-26 17:04:36,588::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721021::DEBUG::2014-06-26 17:04:36,590::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:04:37,198::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:04:37,205::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000480657 s, 818 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:04:37,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:37,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115312 s, 88.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:39,624::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:39,624::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:39,624::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:39,624::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:39,624::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:39,625::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721022::DEBUG::2014-06-26 17:04:39,625::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:04:39,625::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721022::DEBUG::2014-06-26 17:04:39,627::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:39,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:39,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117296 s, 87.3 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:04:41,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:41,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118243 s, 86.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:42,637::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:42,637::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:42,637::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:42,637::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:42,638::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:42,638::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:42,638::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721023::DEBUG::2014-06-26 17:04:42,638::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721023::DEBUG::2014-06-26 17:04:42,639::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:43,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:43,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115444 s, 88.7 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:04:44,400::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:04:44,407::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000245359 s, 2.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:45,650::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:45,651::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:45,651::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:45,651::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:45,651::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:45,651::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721024::DEBUG::2014-06-26 17:04:45,652::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:04:45,652::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721024::DEBUG::2014-06-26 17:04:45,653::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:45,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:45,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118588 s, 86.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:46,382::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:46,382::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:46,382::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:46,382::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:46,382::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:46,382::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:46,383::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721025::DEBUG::2014-06-26 17:04:46,383::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721025::DEBUG::2014-06-26 17:04:46,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`044f862d-9c1d-4010-9203-0df06c8ed156`::moving from state init -> state preparing >Thread-721025::INFO::2014-06-26 17:04:46,384::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721025::INFO::2014-06-26 17:04:46,384::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721025::DEBUG::2014-06-26 17:04:46,385::task::1191::Storage.TaskManager.Task::(prepare) Task=`044f862d-9c1d-4010-9203-0df06c8ed156`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721025::DEBUG::2014-06-26 17:04:46,385::task::595::Storage.TaskManager.Task::(_updateState) Task=`044f862d-9c1d-4010-9203-0df06c8ed156`::moving from state preparing -> state finished >Thread-721025::DEBUG::2014-06-26 17:04:46,385::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721025::DEBUG::2014-06-26 17:04:46,385::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721025::DEBUG::2014-06-26 17:04:46,385::task::993::Storage.TaskManager.Task::(_decref) Task=`044f862d-9c1d-4010-9203-0df06c8ed156`::ref 0 aborting False >Thread-721025::DEBUG::2014-06-26 17:04:46,385::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:46,398::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:46,398::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:46,398::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:46,399::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:46,399::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:46,399::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:46,399::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721026::DEBUG::2014-06-26 17:04:46,399::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721026::DEBUG::2014-06-26 17:04:46,400::task::595::Storage.TaskManager.Task::(_updateState) Task=`223b6a67-6b51-4c73-905d-ca2474962115`::moving from state init -> state preparing >Thread-721026::INFO::2014-06-26 17:04:46,400::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721026::DEBUG::2014-06-26 17:04:46,400::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`30781c89-9c51-4270-98b9-2d2188c44a77`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721026::DEBUG::2014-06-26 17:04:46,401::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721026::DEBUG::2014-06-26 17:04:46,401::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721026::DEBUG::2014-06-26 17:04:46,401::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`30781c89-9c51-4270-98b9-2d2188c44a77`::Granted request >Thread-721026::DEBUG::2014-06-26 17:04:46,401::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`223b6a67-6b51-4c73-905d-ca2474962115`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721026::DEBUG::2014-06-26 17:04:46,401::task::993::Storage.TaskManager.Task::(_decref) Task=`223b6a67-6b51-4c73-905d-ca2474962115`::ref 1 aborting False >Thread-721026::INFO::2014-06-26 17:04:46,403::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721026::DEBUG::2014-06-26 17:04:46,403::task::1191::Storage.TaskManager.Task::(prepare) Task=`223b6a67-6b51-4c73-905d-ca2474962115`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721026::DEBUG::2014-06-26 17:04:46,403::task::595::Storage.TaskManager.Task::(_updateState) Task=`223b6a67-6b51-4c73-905d-ca2474962115`::moving from state preparing -> state finished >Thread-721026::DEBUG::2014-06-26 17:04:46,404::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721026::DEBUG::2014-06-26 17:04:46,404::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721026::DEBUG::2014-06-26 17:04:46,404::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721026::DEBUG::2014-06-26 17:04:46,404::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721026::DEBUG::2014-06-26 17:04:46,404::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721026::DEBUG::2014-06-26 17:04:46,404::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721026::DEBUG::2014-06-26 17:04:46,404::task::993::Storage.TaskManager.Task::(_decref) Task=`223b6a67-6b51-4c73-905d-ca2474962115`::ref 0 aborting False >Thread-721026::DEBUG::2014-06-26 17:04:46,405::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:04:47,209::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:04:47,216::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000499144 s, 787 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:04:47,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:47,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118631 s, 86.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:48,663::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:48,663::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:48,664::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:48,664::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:48,664::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:48,664::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:48,665::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721027::DEBUG::2014-06-26 17:04:48,665::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721027::DEBUG::2014-06-26 17:04:48,666::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:49,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:50,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011863 s, 86.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:51,675::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:51,675::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:51,675::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:51,675::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:51,676::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:51,676::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721028::DEBUG::2014-06-26 17:04:51,676::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:04:51,676::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721028::DEBUG::2014-06-26 17:04:51,678::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f7b83d7-6ecc-44fa-9e1a-d5312bb7d959`::moving from state init -> state preparing >Thread-721028::INFO::2014-06-26 17:04:51,678::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721028::INFO::2014-06-26 17:04:51,678::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000499144', 'lastCheck': '4.5', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000245359', 'lastCheck': '7.3', 'valid': True}} >Thread-721028::DEBUG::2014-06-26 17:04:51,678::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f7b83d7-6ecc-44fa-9e1a-d5312bb7d959`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000499144', 'lastCheck': '4.5', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000245359', 'lastCheck': '7.3', 'valid': True}} >Thread-721028::DEBUG::2014-06-26 17:04:51,678::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f7b83d7-6ecc-44fa-9e1a-d5312bb7d959`::moving from state preparing -> state finished >Thread-721028::DEBUG::2014-06-26 17:04:51,678::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721028::DEBUG::2014-06-26 17:04:51,679::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721028::DEBUG::2014-06-26 17:04:51,679::task::993::Storage.TaskManager.Task::(_decref) Task=`8f7b83d7-6ecc-44fa-9e1a-d5312bb7d959`::ref 0 aborting False >Thread-721028::DEBUG::2014-06-26 17:04:51,681::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:51,712::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:51,713::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:51,713::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:51,713::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:51,713::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:51,713::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:51,714::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721029::DEBUG::2014-06-26 17:04:51,714::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721029::DEBUG::2014-06-26 17:04:51,714::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:52,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:52,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121804 s, 84.1 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:04:54,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:54,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118636 s, 86.3 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:04:54,409::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:04:54,416::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000228516 s, 2.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:54,752::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:54,752::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:54,752::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:54,752::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:54,752::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:54,753::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:54,753::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721030::DEBUG::2014-06-26 17:04:54,753::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721030::DEBUG::2014-06-26 17:04:54,754::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:54,971::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:54,971::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:54,971::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:54,971::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:54,971::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:54,971::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:54,972::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721031::DEBUG::2014-06-26 17:04:54,972::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Volume_extendSize' in bridge >Thread-721031::DEBUG::2014-06-26 17:04:54,972::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:56,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:56,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119643 s, 85.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:56,428::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:56,428::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:56,428::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:56,429::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:56,429::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:56,429::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:56,430::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721032::DEBUG::2014-06-26 17:04:56,430::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721032::DEBUG::2014-06-26 17:04:56,431::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3fe9c9c-ed74-4250-be27-9dd3041da765`::moving from state init -> state preparing >Thread-721032::INFO::2014-06-26 17:04:56,431::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721032::INFO::2014-06-26 17:04:56,431::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721032::DEBUG::2014-06-26 17:04:56,431::task::1191::Storage.TaskManager.Task::(prepare) Task=`c3fe9c9c-ed74-4250-be27-9dd3041da765`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721032::DEBUG::2014-06-26 17:04:56,431::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3fe9c9c-ed74-4250-be27-9dd3041da765`::moving from state preparing -> state finished >Thread-721032::DEBUG::2014-06-26 17:04:56,431::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721032::DEBUG::2014-06-26 17:04:56,431::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721032::DEBUG::2014-06-26 17:04:56,432::task::993::Storage.TaskManager.Task::(_decref) Task=`c3fe9c9c-ed74-4250-be27-9dd3041da765`::ref 0 aborting False >Thread-721032::DEBUG::2014-06-26 17:04:56,432::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:56,446::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:56,446::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:56,446::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:56,446::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:56,446::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:56,447::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:56,447::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721033::DEBUG::2014-06-26 17:04:56,447::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721033::DEBUG::2014-06-26 17:04:56,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`d13463d1-7885-42b8-aa69-d6ed820e8032`::moving from state init -> state preparing >Thread-721033::INFO::2014-06-26 17:04:56,448::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721033::DEBUG::2014-06-26 17:04:56,448::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`ea9954cd-bc54-4dbb-8a68-9fb56ebfcc3b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721033::DEBUG::2014-06-26 17:04:56,448::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721033::DEBUG::2014-06-26 17:04:56,448::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721033::DEBUG::2014-06-26 17:04:56,448::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`ea9954cd-bc54-4dbb-8a68-9fb56ebfcc3b`::Granted request >Thread-721033::DEBUG::2014-06-26 17:04:56,449::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d13463d1-7885-42b8-aa69-d6ed820e8032`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721033::DEBUG::2014-06-26 17:04:56,449::task::993::Storage.TaskManager.Task::(_decref) Task=`d13463d1-7885-42b8-aa69-d6ed820e8032`::ref 1 aborting False >Thread-721033::INFO::2014-06-26 17:04:56,452::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721033::DEBUG::2014-06-26 17:04:56,452::task::1191::Storage.TaskManager.Task::(prepare) Task=`d13463d1-7885-42b8-aa69-d6ed820e8032`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721033::DEBUG::2014-06-26 17:04:56,452::task::595::Storage.TaskManager.Task::(_updateState) Task=`d13463d1-7885-42b8-aa69-d6ed820e8032`::moving from state preparing -> state finished >Thread-721033::DEBUG::2014-06-26 17:04:56,452::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721033::DEBUG::2014-06-26 17:04:56,452::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721033::DEBUG::2014-06-26 17:04:56,452::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721033::DEBUG::2014-06-26 17:04:56,452::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721033::DEBUG::2014-06-26 17:04:56,452::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721033::DEBUG::2014-06-26 17:04:56,452::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721033::DEBUG::2014-06-26 17:04:56,453::task::993::Storage.TaskManager.Task::(_decref) Task=`d13463d1-7885-42b8-aa69-d6ed820e8032`::ref 0 aborting False >Thread-721033::DEBUG::2014-06-26 17:04:56,453::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:04:57,219::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:04:57,226::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000534858 s, 735 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:57,766::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:57,766::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:57,766::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:04:57,766::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:04:57,767::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:04:57,767::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:04:57,767::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721034::DEBUG::2014-06-26 17:04:57,767::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721034::DEBUG::2014-06-26 17:04:57,768::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:04:58,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:04:58,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120133 s, 85.2 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:05:00,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:00,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114963 s, 89.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:00,781::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:00,781::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:00,781::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:00,781::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:00,782::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:00,782::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:00,782::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721035::DEBUG::2014-06-26 17:05:00,782::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721035::DEBUG::2014-06-26 17:05:00,783::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:05:02,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:02,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133055 s, 77.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:03,798::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:03,799::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:03,799::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:03,799::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:03,799::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:03,799::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:03,800::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721036::DEBUG::2014-06-26 17:05:03,800::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721036::DEBUG::2014-06-26 17:05:03,801::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:05:04,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:04,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118762 s, 86.2 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:05:04,418::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:05:04,425::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000227369 s, 2.5 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:05:06,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:06,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174732 s, 58.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:06,479::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:06,480::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:06,481::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:06,482::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:06,483::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:06,485::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:06,488::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721037::DEBUG::2014-06-26 17:05:06,488::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721037::DEBUG::2014-06-26 17:05:06,491::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd8ac453-1d3e-4a1a-b77b-01d7a460e0e1`::moving from state init -> state preparing >Thread-721037::INFO::2014-06-26 17:05:06,492::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721037::INFO::2014-06-26 17:05:06,494::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721037::DEBUG::2014-06-26 17:05:06,495::task::1191::Storage.TaskManager.Task::(prepare) Task=`dd8ac453-1d3e-4a1a-b77b-01d7a460e0e1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721037::DEBUG::2014-06-26 17:05:06,495::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd8ac453-1d3e-4a1a-b77b-01d7a460e0e1`::moving from state preparing -> state finished >Thread-721037::DEBUG::2014-06-26 17:05:06,496::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721037::DEBUG::2014-06-26 17:05:06,497::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721037::DEBUG::2014-06-26 17:05:06,498::task::993::Storage.TaskManager.Task::(_decref) Task=`dd8ac453-1d3e-4a1a-b77b-01d7a460e0e1`::ref 0 aborting False >Thread-721037::DEBUG::2014-06-26 17:05:06,499::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:06,518::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:06,519::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:06,520::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:06,521::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:06,522::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:06,523::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721038::DEBUG::2014-06-26 17:05:06,526::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:05:06,526::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721038::DEBUG::2014-06-26 17:05:06,529::task::595::Storage.TaskManager.Task::(_updateState) Task=`a186ccf9-6314-4369-901d-419ac0bd365c`::moving from state init -> state preparing >Thread-721038::INFO::2014-06-26 17:05:06,530::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721038::DEBUG::2014-06-26 17:05:06,532::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`544dc26c-09c2-4a22-b25d-7b3fac22ee98`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721038::DEBUG::2014-06-26 17:05:06,533::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721038::DEBUG::2014-06-26 17:05:06,534::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721038::DEBUG::2014-06-26 17:05:06,535::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`544dc26c-09c2-4a22-b25d-7b3fac22ee98`::Granted request >Thread-721038::DEBUG::2014-06-26 17:05:06,537::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a186ccf9-6314-4369-901d-419ac0bd365c`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721038::DEBUG::2014-06-26 17:05:06,537::task::993::Storage.TaskManager.Task::(_decref) Task=`a186ccf9-6314-4369-901d-419ac0bd365c`::ref 1 aborting False >Thread-721038::INFO::2014-06-26 17:05:06,556::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721038::DEBUG::2014-06-26 17:05:06,557::task::1191::Storage.TaskManager.Task::(prepare) Task=`a186ccf9-6314-4369-901d-419ac0bd365c`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721038::DEBUG::2014-06-26 17:05:06,557::task::595::Storage.TaskManager.Task::(_updateState) Task=`a186ccf9-6314-4369-901d-419ac0bd365c`::moving from state preparing -> state finished >Thread-721038::DEBUG::2014-06-26 17:05:06,558::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721038::DEBUG::2014-06-26 17:05:06,559::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721038::DEBUG::2014-06-26 17:05:06,560::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721038::DEBUG::2014-06-26 17:05:06,561::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721038::DEBUG::2014-06-26 17:05:06,561::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721038::DEBUG::2014-06-26 17:05:06,562::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721038::DEBUG::2014-06-26 17:05:06,563::task::993::Storage.TaskManager.Task::(_decref) Task=`a186ccf9-6314-4369-901d-419ac0bd365c`::ref 0 aborting False >Thread-721038::DEBUG::2014-06-26 17:05:06,568::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:06,812::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:06,812::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:06,813::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:06,813::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:06,814::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:06,814::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:06,816::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721039::DEBUG::2014-06-26 17:05:06,816::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721039::DEBUG::2014-06-26 17:05:06,819::task::595::Storage.TaskManager.Task::(_updateState) Task=`2cc42a97-06bd-40ab-9899-92367753db22`::moving from state init -> state preparing >Thread-721039::INFO::2014-06-26 17:05:06,820::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721039::INFO::2014-06-26 17:05:06,821::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000534858', 'lastCheck': '9.6', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000227369', 'lastCheck': '2.4', 'valid': True}} >Thread-721039::DEBUG::2014-06-26 17:05:06,821::task::1191::Storage.TaskManager.Task::(prepare) Task=`2cc42a97-06bd-40ab-9899-92367753db22`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000534858', 'lastCheck': '9.6', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000227369', 'lastCheck': '2.4', 'valid': True}} >Thread-721039::DEBUG::2014-06-26 17:05:06,822::task::595::Storage.TaskManager.Task::(_updateState) Task=`2cc42a97-06bd-40ab-9899-92367753db22`::moving from state preparing -> state finished >Thread-721039::DEBUG::2014-06-26 17:05:06,822::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721039::DEBUG::2014-06-26 17:05:06,822::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721039::DEBUG::2014-06-26 17:05:06,823::task::993::Storage.TaskManager.Task::(_decref) Task=`2cc42a97-06bd-40ab-9899-92367753db22`::ref 0 aborting False >Thread-721039::DEBUG::2014-06-26 17:05:06,836::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:06,872::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:06,873::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:06,873::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:06,874::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:06,874::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:06,875::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:06,876::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721040::DEBUG::2014-06-26 17:05:06,876::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721040::DEBUG::2014-06-26 17:05:06,879::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:05:07,229::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:05:07,238::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000513241 s, 766 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:05:08,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:08,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120096 s, 85.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:09,919::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:09,919::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:09,919::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:09,919::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:09,920::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:09,920::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:09,920::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721041::DEBUG::2014-06-26 17:05:09,920::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721041::DEBUG::2014-06-26 17:05:09,921::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:05:10,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:10,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118045 s, 86.7 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:05:12,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:12,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120636 s, 84.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:12,931::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:12,931::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:12,931::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:12,931::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:12,931::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:12,932::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:12,932::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721042::DEBUG::2014-06-26 17:05:12,932::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721042::DEBUG::2014-06-26 17:05:12,933::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:05:14,427::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:05:14,434::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000259111 s, 2.2 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:05:14,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:14,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114838 s, 89.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:15,944::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:15,944::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:15,944::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:15,944::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:15,945::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:15,945::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:15,945::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721043::DEBUG::2014-06-26 17:05:15,945::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721043::DEBUG::2014-06-26 17:05:15,946::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:16,595::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:16,595::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:16,595::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:16,595::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:16,595::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:16,595::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721044::DEBUG::2014-06-26 17:05:16,596::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:05:16,596::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721044::DEBUG::2014-06-26 17:05:16,597::task::595::Storage.TaskManager.Task::(_updateState) Task=`8bbf2eb3-c95c-4ed4-87ad-35dda5291a5a`::moving from state init -> state preparing >Thread-721044::INFO::2014-06-26 17:05:16,597::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721044::INFO::2014-06-26 17:05:16,597::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721044::DEBUG::2014-06-26 17:05:16,597::task::1191::Storage.TaskManager.Task::(prepare) Task=`8bbf2eb3-c95c-4ed4-87ad-35dda5291a5a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721044::DEBUG::2014-06-26 17:05:16,597::task::595::Storage.TaskManager.Task::(_updateState) Task=`8bbf2eb3-c95c-4ed4-87ad-35dda5291a5a`::moving from state preparing -> state finished >Thread-721044::DEBUG::2014-06-26 17:05:16,597::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721044::DEBUG::2014-06-26 17:05:16,597::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721044::DEBUG::2014-06-26 17:05:16,598::task::993::Storage.TaskManager.Task::(_decref) Task=`8bbf2eb3-c95c-4ed4-87ad-35dda5291a5a`::ref 0 aborting False >Thread-721044::DEBUG::2014-06-26 17:05:16,598::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:16,610::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:16,611::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:16,611::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:16,611::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:16,611::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:16,611::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:16,611::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721045::DEBUG::2014-06-26 17:05:16,612::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721045::DEBUG::2014-06-26 17:05:16,612::task::595::Storage.TaskManager.Task::(_updateState) Task=`872e1284-9bcc-4338-9243-110ca8843637`::moving from state init -> state preparing >Thread-721045::INFO::2014-06-26 17:05:16,612::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721045::DEBUG::2014-06-26 17:05:16,613::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`eca78a78-0e66-4a04-b240-cd745160c8ad`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721045::DEBUG::2014-06-26 17:05:16,613::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721045::DEBUG::2014-06-26 17:05:16,613::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721045::DEBUG::2014-06-26 17:05:16,613::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`eca78a78-0e66-4a04-b240-cd745160c8ad`::Granted request >Thread-721045::DEBUG::2014-06-26 17:05:16,613::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`872e1284-9bcc-4338-9243-110ca8843637`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721045::DEBUG::2014-06-26 17:05:16,613::task::993::Storage.TaskManager.Task::(_decref) Task=`872e1284-9bcc-4338-9243-110ca8843637`::ref 1 aborting False >Thread-721045::INFO::2014-06-26 17:05:16,615::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721045::DEBUG::2014-06-26 17:05:16,616::task::1191::Storage.TaskManager.Task::(prepare) Task=`872e1284-9bcc-4338-9243-110ca8843637`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721045::DEBUG::2014-06-26 17:05:16,616::task::595::Storage.TaskManager.Task::(_updateState) Task=`872e1284-9bcc-4338-9243-110ca8843637`::moving from state preparing -> state finished >Thread-721045::DEBUG::2014-06-26 17:05:16,616::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721045::DEBUG::2014-06-26 17:05:16,616::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721045::DEBUG::2014-06-26 17:05:16,616::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721045::DEBUG::2014-06-26 17:05:16,616::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721045::DEBUG::2014-06-26 17:05:16,616::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721045::DEBUG::2014-06-26 17:05:16,616::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721045::DEBUG::2014-06-26 17:05:16,616::task::993::Storage.TaskManager.Task::(_decref) Task=`872e1284-9bcc-4338-9243-110ca8843637`::ref 0 aborting False >Thread-721045::DEBUG::2014-06-26 17:05:16,617::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:05:16,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:16,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117825 s, 86.9 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:05:17,242::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:05:17,249::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000428381 s, 917 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:05:18,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:18,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122176 s, 83.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:18,958::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:18,958::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:18,958::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:18,958::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:18,959::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:18,959::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:18,959::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721046::DEBUG::2014-06-26 17:05:18,959::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721046::DEBUG::2014-06-26 17:05:18,960::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:05:20,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:20,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118496 s, 86.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:21,972::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:21,973::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:21,973::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:21,973::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:21,973::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:21,973::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:21,974::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721047::DEBUG::2014-06-26 17:05:21,974::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721047::DEBUG::2014-06-26 17:05:21,975::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d6e7a8c-a0f3-4a2f-b741-7bf3a4ac0ba7`::moving from state init -> state preparing >Thread-721047::INFO::2014-06-26 17:05:21,975::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721047::INFO::2014-06-26 17:05:21,976::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000428381', 'lastCheck': '4.7', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259111', 'lastCheck': '7.5', 'valid': True}} >Thread-721047::DEBUG::2014-06-26 17:05:21,976::task::1191::Storage.TaskManager.Task::(prepare) Task=`1d6e7a8c-a0f3-4a2f-b741-7bf3a4ac0ba7`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000428381', 'lastCheck': '4.7', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259111', 'lastCheck': '7.5', 'valid': True}} >Thread-721047::DEBUG::2014-06-26 17:05:21,976::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d6e7a8c-a0f3-4a2f-b741-7bf3a4ac0ba7`::moving from state preparing -> state finished >Thread-721047::DEBUG::2014-06-26 17:05:21,976::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721047::DEBUG::2014-06-26 17:05:21,976::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721047::DEBUG::2014-06-26 17:05:21,976::task::993::Storage.TaskManager.Task::(_decref) Task=`1d6e7a8c-a0f3-4a2f-b741-7bf3a4ac0ba7`::ref 0 aborting False >Thread-721047::DEBUG::2014-06-26 17:05:21,978::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:22,023::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:22,023::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:22,024::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:22,024::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:22,024::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:22,024::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:22,024::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721048::DEBUG::2014-06-26 17:05:22,024::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721048::DEBUG::2014-06-26 17:05:22,025::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:05:22,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:22,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011767 s, 87.0 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:05:24,437::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:05:24,444::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000280351 s, 2.0 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:05:24,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:25,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119748 s, 85.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:25,060::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:25,060::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:25,060::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:25,060::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:25,061::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:25,061::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:25,062::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721049::DEBUG::2014-06-26 17:05:25,062::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721049::DEBUG::2014-06-26 17:05:25,063::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:26,637::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:26,638::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:26,638::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:26,638::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:26,638::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:26,638::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:26,638::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721050::DEBUG::2014-06-26 17:05:26,638::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721050::DEBUG::2014-06-26 17:05:26,639::task::595::Storage.TaskManager.Task::(_updateState) Task=`0529ac57-c550-4a64-a039-478d6c2aa085`::moving from state init -> state preparing >Thread-721050::INFO::2014-06-26 17:05:26,639::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721050::INFO::2014-06-26 17:05:26,640::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721050::DEBUG::2014-06-26 17:05:26,640::task::1191::Storage.TaskManager.Task::(prepare) Task=`0529ac57-c550-4a64-a039-478d6c2aa085`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721050::DEBUG::2014-06-26 17:05:26,640::task::595::Storage.TaskManager.Task::(_updateState) Task=`0529ac57-c550-4a64-a039-478d6c2aa085`::moving from state preparing -> state finished >Thread-721050::DEBUG::2014-06-26 17:05:26,640::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721050::DEBUG::2014-06-26 17:05:26,640::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721050::DEBUG::2014-06-26 17:05:26,640::task::993::Storage.TaskManager.Task::(_decref) Task=`0529ac57-c550-4a64-a039-478d6c2aa085`::ref 0 aborting False >Thread-721050::DEBUG::2014-06-26 17:05:26,640::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:26,654::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:26,654::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:26,654::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:26,654::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:26,654::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:26,655::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721051::DEBUG::2014-06-26 17:05:26,655::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:05:26,655::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721051::DEBUG::2014-06-26 17:05:26,656::task::595::Storage.TaskManager.Task::(_updateState) Task=`1463cb21-46fa-4f2c-b289-005221705bd6`::moving from state init -> state preparing >Thread-721051::INFO::2014-06-26 17:05:26,656::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721051::DEBUG::2014-06-26 17:05:26,656::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`34ef9519-b7ed-471c-bed4-62ddbc405339`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721051::DEBUG::2014-06-26 17:05:26,656::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721051::DEBUG::2014-06-26 17:05:26,656::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721051::DEBUG::2014-06-26 17:05:26,657::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`34ef9519-b7ed-471c-bed4-62ddbc405339`::Granted request >Thread-721051::DEBUG::2014-06-26 17:05:26,657::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1463cb21-46fa-4f2c-b289-005221705bd6`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721051::DEBUG::2014-06-26 17:05:26,657::task::993::Storage.TaskManager.Task::(_decref) Task=`1463cb21-46fa-4f2c-b289-005221705bd6`::ref 1 aborting False >Thread-721051::INFO::2014-06-26 17:05:26,659::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721051::DEBUG::2014-06-26 17:05:26,659::task::1191::Storage.TaskManager.Task::(prepare) Task=`1463cb21-46fa-4f2c-b289-005221705bd6`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721051::DEBUG::2014-06-26 17:05:26,659::task::595::Storage.TaskManager.Task::(_updateState) Task=`1463cb21-46fa-4f2c-b289-005221705bd6`::moving from state preparing -> state finished >Thread-721051::DEBUG::2014-06-26 17:05:26,659::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721051::DEBUG::2014-06-26 17:05:26,659::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721051::DEBUG::2014-06-26 17:05:26,660::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721051::DEBUG::2014-06-26 17:05:26,660::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721051::DEBUG::2014-06-26 17:05:26,660::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721051::DEBUG::2014-06-26 17:05:26,660::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721051::DEBUG::2014-06-26 17:05:26,660::task::993::Storage.TaskManager.Task::(_decref) Task=`1463cb21-46fa-4f2c-b289-005221705bd6`::ref 0 aborting False >Thread-721051::DEBUG::2014-06-26 17:05:26,660::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:05:27,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:27,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117868 s, 86.9 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:05:27,251::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:05:27,259::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000430055 s, 914 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:28,074::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:28,074::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:28,074::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:28,074::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:28,075::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:28,075::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:28,075::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721052::DEBUG::2014-06-26 17:05:28,075::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721052::DEBUG::2014-06-26 17:05:28,076::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:05:29,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:29,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116456 s, 87.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:31,087::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:31,087::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:31,088::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:31,088::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:31,088::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:31,088::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:31,089::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721053::DEBUG::2014-06-26 17:05:31,089::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721053::DEBUG::2014-06-26 17:05:31,090::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:05:31,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:31,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118335 s, 86.5 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:05:33,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:33,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011616 s, 88.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:34,101::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:34,101::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:34,101::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:34,101::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:34,101::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:34,101::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721054::DEBUG::2014-06-26 17:05:34,102::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:05:34,102::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721054::DEBUG::2014-06-26 17:05:34,103::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:05:34,446::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:05:34,452::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.00024045 s, 2.3 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:05:35,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:35,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011856 s, 86.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:36,684::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:36,685::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:36,685::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:36,686::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:36,687::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:36,687::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:36,689::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721055::DEBUG::2014-06-26 17:05:36,689::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721055::DEBUG::2014-06-26 17:05:36,691::task::595::Storage.TaskManager.Task::(_updateState) Task=`47c355fd-8ecf-4248-9078-273f975219eb`::moving from state init -> state preparing >Thread-721055::INFO::2014-06-26 17:05:36,692::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721055::INFO::2014-06-26 17:05:36,693::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721055::DEBUG::2014-06-26 17:05:36,693::task::1191::Storage.TaskManager.Task::(prepare) Task=`47c355fd-8ecf-4248-9078-273f975219eb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721055::DEBUG::2014-06-26 17:05:36,694::task::595::Storage.TaskManager.Task::(_updateState) Task=`47c355fd-8ecf-4248-9078-273f975219eb`::moving from state preparing -> state finished >Thread-721055::DEBUG::2014-06-26 17:05:36,694::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721055::DEBUG::2014-06-26 17:05:36,695::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721055::DEBUG::2014-06-26 17:05:36,695::task::993::Storage.TaskManager.Task::(_decref) Task=`47c355fd-8ecf-4248-9078-273f975219eb`::ref 0 aborting False >Thread-721055::DEBUG::2014-06-26 17:05:36,696::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:36,711::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:36,712::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:36,712::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:36,713::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:36,713::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:36,714::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:36,715::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721056::DEBUG::2014-06-26 17:05:36,715::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721056::DEBUG::2014-06-26 17:05:36,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b470780-f3bb-46fb-877d-321d3fa2f6ba`::moving from state init -> state preparing >Thread-721056::INFO::2014-06-26 17:05:36,718::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721056::DEBUG::2014-06-26 17:05:36,719::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`bcefb4fb-cbf2-4cc4-8945-5adb2bdc92b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721056::DEBUG::2014-06-26 17:05:36,719::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721056::DEBUG::2014-06-26 17:05:36,720::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721056::DEBUG::2014-06-26 17:05:36,720::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`bcefb4fb-cbf2-4cc4-8945-5adb2bdc92b8`::Granted request >Thread-721056::DEBUG::2014-06-26 17:05:36,721::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1b470780-f3bb-46fb-877d-321d3fa2f6ba`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721056::DEBUG::2014-06-26 17:05:36,722::task::993::Storage.TaskManager.Task::(_decref) Task=`1b470780-f3bb-46fb-877d-321d3fa2f6ba`::ref 1 aborting False >Thread-721056::INFO::2014-06-26 17:05:36,732::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721056::DEBUG::2014-06-26 17:05:36,733::task::1191::Storage.TaskManager.Task::(prepare) Task=`1b470780-f3bb-46fb-877d-321d3fa2f6ba`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721056::DEBUG::2014-06-26 17:05:36,733::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b470780-f3bb-46fb-877d-321d3fa2f6ba`::moving from state preparing -> state finished >Thread-721056::DEBUG::2014-06-26 17:05:36,733::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721056::DEBUG::2014-06-26 17:05:36,734::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721056::DEBUG::2014-06-26 17:05:36,735::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721056::DEBUG::2014-06-26 17:05:36,735::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721056::DEBUG::2014-06-26 17:05:36,736::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721056::DEBUG::2014-06-26 17:05:36,736::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721056::DEBUG::2014-06-26 17:05:36,737::task::993::Storage.TaskManager.Task::(_decref) Task=`1b470780-f3bb-46fb-877d-321d3fa2f6ba`::ref 0 aborting False >Thread-721056::DEBUG::2014-06-26 17:05:36,739::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:37,114::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:37,115::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:37,115::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:37,115::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:37,116::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:37,117::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:37,118::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721057::DEBUG::2014-06-26 17:05:37,118::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721057::DEBUG::2014-06-26 17:05:37,122::task::595::Storage.TaskManager.Task::(_updateState) Task=`f51f0643-bfbd-4ca9-a6df-0c15a2e8cda5`::moving from state init -> state preparing >Thread-721057::INFO::2014-06-26 17:05:37,122::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721057::INFO::2014-06-26 17:05:37,123::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000430055', 'lastCheck': '9.9', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00024045', 'lastCheck': '2.7', 'valid': True}} >Thread-721057::DEBUG::2014-06-26 17:05:37,124::task::1191::Storage.TaskManager.Task::(prepare) Task=`f51f0643-bfbd-4ca9-a6df-0c15a2e8cda5`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000430055', 'lastCheck': '9.9', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00024045', 'lastCheck': '2.7', 'valid': True}} >Thread-721057::DEBUG::2014-06-26 17:05:37,124::task::595::Storage.TaskManager.Task::(_updateState) Task=`f51f0643-bfbd-4ca9-a6df-0c15a2e8cda5`::moving from state preparing -> state finished >Thread-721057::DEBUG::2014-06-26 17:05:37,124::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721057::DEBUG::2014-06-26 17:05:37,125::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721057::DEBUG::2014-06-26 17:05:37,125::task::993::Storage.TaskManager.Task::(_decref) Task=`f51f0643-bfbd-4ca9-a6df-0c15a2e8cda5`::ref 0 aborting False >Thread-721057::DEBUG::2014-06-26 17:05:37,139::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:37,175::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:37,176::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:37,176::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:37,176::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:37,177::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:37,177::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:37,179::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721058::DEBUG::2014-06-26 17:05:37,179::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721058::DEBUG::2014-06-26 17:05:37,181::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:05:37,262::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:05:37,270::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000420604 s, 934 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:05:37,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:37,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179682 s, 57.0 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:05:39,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:39,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119389 s, 85.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:40,223::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:40,223::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:40,223::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:40,223::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:40,223::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:40,223::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:40,224::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721059::DEBUG::2014-06-26 17:05:40,224::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721059::DEBUG::2014-06-26 17:05:40,225::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:05:41,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:41,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117142 s, 87.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:43,237::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:43,237::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:43,238::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:43,238::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:43,238::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:43,238::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:43,239::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721060::DEBUG::2014-06-26 17:05:43,239::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721060::DEBUG::2014-06-26 17:05:43,240::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:05:43,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:43,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118892 s, 86.1 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:05:44,455::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:05:44,461::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000219853 s, 2.5 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:05:45,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:45,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120864 s, 84.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:46,251::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:46,251::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:46,251::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:46,251::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:46,251::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:46,252::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:46,252::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721061::DEBUG::2014-06-26 17:05:46,252::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721061::DEBUG::2014-06-26 17:05:46,253::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:46,764::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:46,764::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:46,764::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:46,764::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:46,765::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:46,765::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:46,765::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721062::DEBUG::2014-06-26 17:05:46,765::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721062::DEBUG::2014-06-26 17:05:46,766::task::595::Storage.TaskManager.Task::(_updateState) Task=`5cb6e3ab-9ef3-4a9f-af83-5106fc9fc1b0`::moving from state init -> state preparing >Thread-721062::INFO::2014-06-26 17:05:46,766::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721062::INFO::2014-06-26 17:05:46,767::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721062::DEBUG::2014-06-26 17:05:46,767::task::1191::Storage.TaskManager.Task::(prepare) Task=`5cb6e3ab-9ef3-4a9f-af83-5106fc9fc1b0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721062::DEBUG::2014-06-26 17:05:46,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`5cb6e3ab-9ef3-4a9f-af83-5106fc9fc1b0`::moving from state preparing -> state finished >Thread-721062::DEBUG::2014-06-26 17:05:46,767::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721062::DEBUG::2014-06-26 17:05:46,767::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721062::DEBUG::2014-06-26 17:05:46,767::task::993::Storage.TaskManager.Task::(_decref) Task=`5cb6e3ab-9ef3-4a9f-af83-5106fc9fc1b0`::ref 0 aborting False >Thread-721062::DEBUG::2014-06-26 17:05:46,767::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:46,781::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:46,781::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:46,781::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:46,782::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:46,782::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:46,782::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:46,783::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721063::DEBUG::2014-06-26 17:05:46,783::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721063::DEBUG::2014-06-26 17:05:46,783::task::595::Storage.TaskManager.Task::(_updateState) Task=`38ab7ae5-7ed5-4031-8078-615d3246923d`::moving from state init -> state preparing >Thread-721063::INFO::2014-06-26 17:05:46,783::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721063::DEBUG::2014-06-26 17:05:46,784::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`57dfaf87-0cab-44f1-8f13-b3e1ced1f072`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721063::DEBUG::2014-06-26 17:05:46,784::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721063::DEBUG::2014-06-26 17:05:46,784::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721063::DEBUG::2014-06-26 17:05:46,784::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`57dfaf87-0cab-44f1-8f13-b3e1ced1f072`::Granted request >Thread-721063::DEBUG::2014-06-26 17:05:46,784::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`38ab7ae5-7ed5-4031-8078-615d3246923d`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721063::DEBUG::2014-06-26 17:05:46,784::task::993::Storage.TaskManager.Task::(_decref) Task=`38ab7ae5-7ed5-4031-8078-615d3246923d`::ref 1 aborting False >Thread-721063::INFO::2014-06-26 17:05:46,787::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721063::DEBUG::2014-06-26 17:05:46,787::task::1191::Storage.TaskManager.Task::(prepare) Task=`38ab7ae5-7ed5-4031-8078-615d3246923d`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721063::DEBUG::2014-06-26 17:05:46,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`38ab7ae5-7ed5-4031-8078-615d3246923d`::moving from state preparing -> state finished >Thread-721063::DEBUG::2014-06-26 17:05:46,787::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721063::DEBUG::2014-06-26 17:05:46,787::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721063::DEBUG::2014-06-26 17:05:46,787::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721063::DEBUG::2014-06-26 17:05:46,788::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721063::DEBUG::2014-06-26 17:05:46,788::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721063::DEBUG::2014-06-26 17:05:46,788::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721063::DEBUG::2014-06-26 17:05:46,788::task::993::Storage.TaskManager.Task::(_decref) Task=`38ab7ae5-7ed5-4031-8078-615d3246923d`::ref 0 aborting False >Thread-721063::DEBUG::2014-06-26 17:05:46,788::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:05:47,274::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:05:47,280::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000498794 s, 788 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:05:47,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:47,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118063 s, 86.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:49,264::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:49,264::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:49,264::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:49,264::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:49,264::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:49,265::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:49,265::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721064::DEBUG::2014-06-26 17:05:49,265::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721064::DEBUG::2014-06-26 17:05:49,266::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:05:49,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:49,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119313 s, 85.8 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:05:51,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:51,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115719 s, 88.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:52,281::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:52,281::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:52,281::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:52,281::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:52,281::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:52,282::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721065::DEBUG::2014-06-26 17:05:52,282::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:05:52,282::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721065::DEBUG::2014-06-26 17:05:52,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`de642a47-b53a-4843-8a5c-234970026387`::moving from state init -> state preparing >Thread-721065::INFO::2014-06-26 17:05:52,284::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721065::INFO::2014-06-26 17:05:52,284::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000498794', 'lastCheck': '5.0', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000219853', 'lastCheck': '7.8', 'valid': True}} >Thread-721065::DEBUG::2014-06-26 17:05:52,284::task::1191::Storage.TaskManager.Task::(prepare) Task=`de642a47-b53a-4843-8a5c-234970026387`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000498794', 'lastCheck': '5.0', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000219853', 'lastCheck': '7.8', 'valid': True}} >Thread-721065::DEBUG::2014-06-26 17:05:52,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`de642a47-b53a-4843-8a5c-234970026387`::moving from state preparing -> state finished >Thread-721065::DEBUG::2014-06-26 17:05:52,284::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721065::DEBUG::2014-06-26 17:05:52,284::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721065::DEBUG::2014-06-26 17:05:52,284::task::993::Storage.TaskManager.Task::(_decref) Task=`de642a47-b53a-4843-8a5c-234970026387`::ref 0 aborting False >Thread-721065::DEBUG::2014-06-26 17:05:52,286::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:52,320::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:52,320::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:52,320::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:52,321::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:52,321::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:52,321::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:52,321::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721066::DEBUG::2014-06-26 17:05:52,321::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721066::DEBUG::2014-06-26 17:05:52,322::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:05:53,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:53,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119169 s, 85.9 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:05:54,464::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:05:54,470::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000244107 s, 2.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:55,357::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:55,357::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:55,357::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:55,357::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:55,358::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:55,358::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721067::DEBUG::2014-06-26 17:05:55,359::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:05:55,359::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721067::DEBUG::2014-06-26 17:05:55,360::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:05:55,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:55,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118635 s, 86.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:56,814::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:56,815::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:56,815::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:56,815::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:56,815::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:56,815::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:56,816::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721068::DEBUG::2014-06-26 17:05:56,816::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721068::DEBUG::2014-06-26 17:05:56,817::task::595::Storage.TaskManager.Task::(_updateState) Task=`93b9572b-73d6-4989-9c24-79dc8a7b23ff`::moving from state init -> state preparing >Thread-721068::INFO::2014-06-26 17:05:56,817::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721068::INFO::2014-06-26 17:05:56,817::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721068::DEBUG::2014-06-26 17:05:56,817::task::1191::Storage.TaskManager.Task::(prepare) Task=`93b9572b-73d6-4989-9c24-79dc8a7b23ff`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721068::DEBUG::2014-06-26 17:05:56,817::task::595::Storage.TaskManager.Task::(_updateState) Task=`93b9572b-73d6-4989-9c24-79dc8a7b23ff`::moving from state preparing -> state finished >Thread-721068::DEBUG::2014-06-26 17:05:56,817::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721068::DEBUG::2014-06-26 17:05:56,818::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721068::DEBUG::2014-06-26 17:05:56,818::task::993::Storage.TaskManager.Task::(_decref) Task=`93b9572b-73d6-4989-9c24-79dc8a7b23ff`::ref 0 aborting False >Thread-721068::DEBUG::2014-06-26 17:05:56,818::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:56,832::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:56,832::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:56,832::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:56,832::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:56,832::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:56,832::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:56,833::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721069::DEBUG::2014-06-26 17:05:56,833::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721069::DEBUG::2014-06-26 17:05:56,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`e472fab2-fe49-4935-97a9-7b10c39a3841`::moving from state init -> state preparing >Thread-721069::INFO::2014-06-26 17:05:56,833::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721069::DEBUG::2014-06-26 17:05:56,834::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`a389c2b8-59f5-4f21-8cf0-33fdcd89b1b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721069::DEBUG::2014-06-26 17:05:56,834::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721069::DEBUG::2014-06-26 17:05:56,834::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721069::DEBUG::2014-06-26 17:05:56,834::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`a389c2b8-59f5-4f21-8cf0-33fdcd89b1b0`::Granted request >Thread-721069::DEBUG::2014-06-26 17:05:56,834::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e472fab2-fe49-4935-97a9-7b10c39a3841`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721069::DEBUG::2014-06-26 17:05:56,834::task::993::Storage.TaskManager.Task::(_decref) Task=`e472fab2-fe49-4935-97a9-7b10c39a3841`::ref 1 aborting False >Thread-721069::INFO::2014-06-26 17:05:56,837::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721069::DEBUG::2014-06-26 17:05:56,837::task::1191::Storage.TaskManager.Task::(prepare) Task=`e472fab2-fe49-4935-97a9-7b10c39a3841`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721069::DEBUG::2014-06-26 17:05:56,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`e472fab2-fe49-4935-97a9-7b10c39a3841`::moving from state preparing -> state finished >Thread-721069::DEBUG::2014-06-26 17:05:56,837::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721069::DEBUG::2014-06-26 17:05:56,837::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721069::DEBUG::2014-06-26 17:05:56,837::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721069::DEBUG::2014-06-26 17:05:56,837::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721069::DEBUG::2014-06-26 17:05:56,837::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721069::DEBUG::2014-06-26 17:05:56,837::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721069::DEBUG::2014-06-26 17:05:56,838::task::993::Storage.TaskManager.Task::(_decref) Task=`e472fab2-fe49-4935-97a9-7b10c39a3841`::ref 0 aborting False >Thread-721069::DEBUG::2014-06-26 17:05:56,838::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:05:57,283::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:05:57,290::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.00055087 s, 713 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:05:57,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:57,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118952 s, 86.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:58,371::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:58,371::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:58,371::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:05:58,371::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:05:58,372::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:05:58,372::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:05:58,372::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721070::DEBUG::2014-06-26 17:05:58,373::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721070::DEBUG::2014-06-26 17:05:58,374::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:05:59,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:05:59,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117438 s, 87.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:01,386::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:01,386::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:01,386::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:01,386::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:01,387::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:01,387::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:01,387::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721071::DEBUG::2014-06-26 17:06:01,387::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721071::DEBUG::2014-06-26 17:06:01,388::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:06:01,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:01,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119831 s, 85.5 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:06:03,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:04,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115587 s, 88.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:04,400::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:04,400::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:04,400::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:04,400::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:04,400::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:04,401::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:04,401::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721072::DEBUG::2014-06-26 17:06:04,401::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721072::DEBUG::2014-06-26 17:06:04,402::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:06:04,472::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 79aa2072-3ab5-4887-865c-dbb4b6467849 >Thread-160::DEBUG::2014-06-26 17:06:04,477::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849 >Thread-160::DEBUG::2014-06-26 17:06:04,478::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-160::DEBUG::2014-06-26 17:06:04,479::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=master', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=34', 'POOL_DOMAINS=9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=00161ead-084f-42e0-bbdf-6be74f182a50', 'REMOTE_PATH=10.34.63.202:/mnt/export/nfs/lv3/pbenas/35', 'ROLE=Master', 'SDUUID=79aa2072-3ab5-4887-865c-dbb4b6467849', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=b52410f15cd0b1978afafaf4ca1d215a2d5da3ce'] >Thread-160::DEBUG::2014-06-26 17:06:04,480::fileSD::619::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-160::INFO::2014-06-26 17:06:04,481::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 79aa2072-3ab5-4887-865c-dbb4b6467849_imageNS already registered >Thread-160::INFO::2014-06-26 17:06:04,481::sd::391::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 79aa2072-3ab5-4887-865c-dbb4b6467849_volumeNS already registered >Thread-160::DEBUG::2014-06-26 17:06:04,481::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:06:04,488::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000255133 s, 2.2 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:06:06,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:06,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116872 s, 87.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:06,865::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:06,866::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:06,866::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:06,866::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:06,867::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:06,868::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:06,869::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721077::DEBUG::2014-06-26 17:06:06,869::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721077::DEBUG::2014-06-26 17:06:06,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`461a9bf8-4d8a-4506-828a-91d30f7a76be`::moving from state init -> state preparing >Thread-721077::INFO::2014-06-26 17:06:06,872::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721077::INFO::2014-06-26 17:06:06,873::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721077::DEBUG::2014-06-26 17:06:06,874::task::1191::Storage.TaskManager.Task::(prepare) Task=`461a9bf8-4d8a-4506-828a-91d30f7a76be`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721077::DEBUG::2014-06-26 17:06:06,874::task::595::Storage.TaskManager.Task::(_updateState) Task=`461a9bf8-4d8a-4506-828a-91d30f7a76be`::moving from state preparing -> state finished >Thread-721077::DEBUG::2014-06-26 17:06:06,874::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721077::DEBUG::2014-06-26 17:06:06,875::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721077::DEBUG::2014-06-26 17:06:06,875::task::993::Storage.TaskManager.Task::(_decref) Task=`461a9bf8-4d8a-4506-828a-91d30f7a76be`::ref 0 aborting False >Thread-721077::DEBUG::2014-06-26 17:06:06,876::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:06,892::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:06,893::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:06,893::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:06,893::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:06,894::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:06,895::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:06,896::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721078::DEBUG::2014-06-26 17:06:06,896::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721078::DEBUG::2014-06-26 17:06:06,898::task::595::Storage.TaskManager.Task::(_updateState) Task=`74f154ea-1d69-40f2-8098-54f384eac9d4`::moving from state init -> state preparing >Thread-721078::INFO::2014-06-26 17:06:06,899::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721078::DEBUG::2014-06-26 17:06:06,900::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`81df5ae3-5359-45c3-8cc3-dab49342daeb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721078::DEBUG::2014-06-26 17:06:06,900::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721078::DEBUG::2014-06-26 17:06:06,902::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721078::DEBUG::2014-06-26 17:06:06,902::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`81df5ae3-5359-45c3-8cc3-dab49342daeb`::Granted request >Thread-721078::DEBUG::2014-06-26 17:06:06,903::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`74f154ea-1d69-40f2-8098-54f384eac9d4`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721078::DEBUG::2014-06-26 17:06:06,904::task::993::Storage.TaskManager.Task::(_decref) Task=`74f154ea-1d69-40f2-8098-54f384eac9d4`::ref 1 aborting False >Thread-721078::INFO::2014-06-26 17:06:06,915::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721078::DEBUG::2014-06-26 17:06:06,915::task::1191::Storage.TaskManager.Task::(prepare) Task=`74f154ea-1d69-40f2-8098-54f384eac9d4`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721078::DEBUG::2014-06-26 17:06:06,916::task::595::Storage.TaskManager.Task::(_updateState) Task=`74f154ea-1d69-40f2-8098-54f384eac9d4`::moving from state preparing -> state finished >Thread-721078::DEBUG::2014-06-26 17:06:06,916::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721078::DEBUG::2014-06-26 17:06:06,916::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721078::DEBUG::2014-06-26 17:06:06,917::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721078::DEBUG::2014-06-26 17:06:06,918::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721078::DEBUG::2014-06-26 17:06:06,918::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721078::DEBUG::2014-06-26 17:06:06,918::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721078::DEBUG::2014-06-26 17:06:06,919::task::993::Storage.TaskManager.Task::(_decref) Task=`74f154ea-1d69-40f2-8098-54f384eac9d4`::ref 0 aborting False >Thread-721078::DEBUG::2014-06-26 17:06:06,922::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:06:07,294::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:06:07,302::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000466581 s, 842 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:07,414::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:07,414::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:07,414::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:07,414::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:07,414::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:07,414::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:07,415::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721079::DEBUG::2014-06-26 17:06:07,415::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721079::DEBUG::2014-06-26 17:06:07,416::task::595::Storage.TaskManager.Task::(_updateState) Task=`2998bc73-f43c-4c2e-b3df-acc200839f30`::moving from state init -> state preparing >Thread-721079::INFO::2014-06-26 17:06:07,416::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721079::INFO::2014-06-26 17:06:07,417::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000466581', 'lastCheck': '0.1', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255133', 'lastCheck': '2.9', 'valid': True}} >Thread-721079::DEBUG::2014-06-26 17:06:07,417::task::1191::Storage.TaskManager.Task::(prepare) Task=`2998bc73-f43c-4c2e-b3df-acc200839f30`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000466581', 'lastCheck': '0.1', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255133', 'lastCheck': '2.9', 'valid': True}} >Thread-721079::DEBUG::2014-06-26 17:06:07,417::task::595::Storage.TaskManager.Task::(_updateState) Task=`2998bc73-f43c-4c2e-b3df-acc200839f30`::moving from state preparing -> state finished >Thread-721079::DEBUG::2014-06-26 17:06:07,417::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721079::DEBUG::2014-06-26 17:06:07,417::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721079::DEBUG::2014-06-26 17:06:07,417::task::993::Storage.TaskManager.Task::(_decref) Task=`2998bc73-f43c-4c2e-b3df-acc200839f30`::ref 0 aborting False >Thread-721079::DEBUG::2014-06-26 17:06:07,419::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:07,459::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:07,459::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:07,459::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:07,459::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:07,459::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:07,459::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:07,460::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721080::DEBUG::2014-06-26 17:06:07,460::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721080::DEBUG::2014-06-26 17:06:07,461::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:06:08,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:08,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116471 s, 87.9 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:06:10,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:10,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117234 s, 87.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:10,501::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:10,501::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:10,501::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:10,501::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:10,502::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:10,502::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:10,502::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721081::DEBUG::2014-06-26 17:06:10,502::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721081::DEBUG::2014-06-26 17:06:10,503::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:06:12,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:12,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011694 s, 87.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:13,515::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:13,515::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:13,515::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:13,515::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:13,515::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:13,515::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:13,516::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721082::DEBUG::2014-06-26 17:06:13,516::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721082::DEBUG::2014-06-26 17:06:13,517::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:06:14,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:14,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116376 s, 88.0 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:06:14,490::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:06:14,497::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000244633 s, 2.3 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:06:16,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:16,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120712 s, 84.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:16,529::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:16,529::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:16,529::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:16,529::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:16,529::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:16,530::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:16,530::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721083::DEBUG::2014-06-26 17:06:16,530::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721083::DEBUG::2014-06-26 17:06:16,531::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:16,952::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:16,953::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:16,953::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:16,953::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:16,953::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:16,953::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:16,954::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721084::DEBUG::2014-06-26 17:06:16,954::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721084::DEBUG::2014-06-26 17:06:16,954::task::595::Storage.TaskManager.Task::(_updateState) Task=`86fb8da8-4705-41ce-9ee6-bc8abafabe64`::moving from state init -> state preparing >Thread-721084::INFO::2014-06-26 17:06:16,955::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721084::INFO::2014-06-26 17:06:16,955::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721084::DEBUG::2014-06-26 17:06:16,955::task::1191::Storage.TaskManager.Task::(prepare) Task=`86fb8da8-4705-41ce-9ee6-bc8abafabe64`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721084::DEBUG::2014-06-26 17:06:16,955::task::595::Storage.TaskManager.Task::(_updateState) Task=`86fb8da8-4705-41ce-9ee6-bc8abafabe64`::moving from state preparing -> state finished >Thread-721084::DEBUG::2014-06-26 17:06:16,955::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721084::DEBUG::2014-06-26 17:06:16,955::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721084::DEBUG::2014-06-26 17:06:16,955::task::993::Storage.TaskManager.Task::(_decref) Task=`86fb8da8-4705-41ce-9ee6-bc8abafabe64`::ref 0 aborting False >Thread-721084::DEBUG::2014-06-26 17:06:16,955::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:16,972::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:16,972::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:16,972::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:16,972::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:16,972::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:16,972::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:16,973::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721085::DEBUG::2014-06-26 17:06:16,973::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721085::DEBUG::2014-06-26 17:06:16,973::task::595::Storage.TaskManager.Task::(_updateState) Task=`3cfa8c0c-fed7-4391-a3f1-ecb0fd737471`::moving from state init -> state preparing >Thread-721085::INFO::2014-06-26 17:06:16,974::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721085::DEBUG::2014-06-26 17:06:16,974::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`6846e4ea-eafb-432f-b506-6746df32ec8c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721085::DEBUG::2014-06-26 17:06:16,974::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721085::DEBUG::2014-06-26 17:06:16,974::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721085::DEBUG::2014-06-26 17:06:16,974::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`6846e4ea-eafb-432f-b506-6746df32ec8c`::Granted request >Thread-721085::DEBUG::2014-06-26 17:06:16,975::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3cfa8c0c-fed7-4391-a3f1-ecb0fd737471`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721085::DEBUG::2014-06-26 17:06:16,975::task::993::Storage.TaskManager.Task::(_decref) Task=`3cfa8c0c-fed7-4391-a3f1-ecb0fd737471`::ref 1 aborting False >Thread-721085::INFO::2014-06-26 17:06:16,977::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721085::DEBUG::2014-06-26 17:06:16,977::task::1191::Storage.TaskManager.Task::(prepare) Task=`3cfa8c0c-fed7-4391-a3f1-ecb0fd737471`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721085::DEBUG::2014-06-26 17:06:16,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`3cfa8c0c-fed7-4391-a3f1-ecb0fd737471`::moving from state preparing -> state finished >Thread-721085::DEBUG::2014-06-26 17:06:16,977::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721085::DEBUG::2014-06-26 17:06:16,977::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721085::DEBUG::2014-06-26 17:06:16,977::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721085::DEBUG::2014-06-26 17:06:16,977::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721085::DEBUG::2014-06-26 17:06:16,978::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721085::DEBUG::2014-06-26 17:06:16,978::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721085::DEBUG::2014-06-26 17:06:16,978::task::993::Storage.TaskManager.Task::(_decref) Task=`3cfa8c0c-fed7-4391-a3f1-ecb0fd737471`::ref 0 aborting False >Thread-721085::DEBUG::2014-06-26 17:06:16,978::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:06:17,306::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:06:17,313::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000536914 s, 732 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:06:18,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:18,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119544 s, 85.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:19,542::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:19,542::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:19,542::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:19,542::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:19,542::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:19,543::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:19,543::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721086::DEBUG::2014-06-26 17:06:19,543::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721086::DEBUG::2014-06-26 17:06:19,544::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:06:20,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:20,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119397 s, 85.8 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:06:22,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:22,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119846 s, 85.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:22,555::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:22,555::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:22,556::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:22,556::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:22,556::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:22,556::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:22,557::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721087::DEBUG::2014-06-26 17:06:22,557::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721087::DEBUG::2014-06-26 17:06:22,558::task::595::Storage.TaskManager.Task::(_updateState) Task=`4a457dbc-dc9d-4891-a762-4b5e5f5197e8`::moving from state init -> state preparing >Thread-721087::INFO::2014-06-26 17:06:22,558::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721087::INFO::2014-06-26 17:06:22,558::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000536914', 'lastCheck': '5.2', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000244633', 'lastCheck': '8.1', 'valid': True}} >Thread-721087::DEBUG::2014-06-26 17:06:22,559::task::1191::Storage.TaskManager.Task::(prepare) Task=`4a457dbc-dc9d-4891-a762-4b5e5f5197e8`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000536914', 'lastCheck': '5.2', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000244633', 'lastCheck': '8.1', 'valid': True}} >Thread-721087::DEBUG::2014-06-26 17:06:22,559::task::595::Storage.TaskManager.Task::(_updateState) Task=`4a457dbc-dc9d-4891-a762-4b5e5f5197e8`::moving from state preparing -> state finished >Thread-721087::DEBUG::2014-06-26 17:06:22,559::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721087::DEBUG::2014-06-26 17:06:22,559::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721087::DEBUG::2014-06-26 17:06:22,559::task::993::Storage.TaskManager.Task::(_decref) Task=`4a457dbc-dc9d-4891-a762-4b5e5f5197e8`::ref 0 aborting False >Thread-721087::DEBUG::2014-06-26 17:06:22,561::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:22,594::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:22,594::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:22,594::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:22,595::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:22,595::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:22,595::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:22,595::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721088::DEBUG::2014-06-26 17:06:22,595::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721088::DEBUG::2014-06-26 17:06:22,596::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:06:24,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-160::DEBUG::2014-06-26 17:06:24,505::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:06:24,512::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000198572 s, 2.8 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:06:24,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0222237 s, 46.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:25,628::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:25,629::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:25,629::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:25,629::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:25,629::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:25,629::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:25,630::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721089::DEBUG::2014-06-26 17:06:25,630::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721089::DEBUG::2014-06-26 17:06:25,631::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:06:26,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:26,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116553 s, 87.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:27,012::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:27,012::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:27,012::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:27,012::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:27,012::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:27,013::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:27,013::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721090::DEBUG::2014-06-26 17:06:27,013::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721090::DEBUG::2014-06-26 17:06:27,014::task::595::Storage.TaskManager.Task::(_updateState) Task=`fdf47f60-df8c-47f5-a8c3-2b6efd1ac6a1`::moving from state init -> state preparing >Thread-721090::INFO::2014-06-26 17:06:27,014::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721090::INFO::2014-06-26 17:06:27,014::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721090::DEBUG::2014-06-26 17:06:27,015::task::1191::Storage.TaskManager.Task::(prepare) Task=`fdf47f60-df8c-47f5-a8c3-2b6efd1ac6a1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721090::DEBUG::2014-06-26 17:06:27,015::task::595::Storage.TaskManager.Task::(_updateState) Task=`fdf47f60-df8c-47f5-a8c3-2b6efd1ac6a1`::moving from state preparing -> state finished >Thread-721090::DEBUG::2014-06-26 17:06:27,015::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721090::DEBUG::2014-06-26 17:06:27,015::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721090::DEBUG::2014-06-26 17:06:27,015::task::993::Storage.TaskManager.Task::(_decref) Task=`fdf47f60-df8c-47f5-a8c3-2b6efd1ac6a1`::ref 0 aborting False >Thread-721090::DEBUG::2014-06-26 17:06:27,015::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:27,029::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:27,030::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:27,030::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:27,030::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:27,030::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:27,030::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:27,031::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721091::DEBUG::2014-06-26 17:06:27,031::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721091::DEBUG::2014-06-26 17:06:27,031::task::595::Storage.TaskManager.Task::(_updateState) Task=`cda51861-e316-4266-8efd-a87d7f2896e8`::moving from state init -> state preparing >Thread-721091::INFO::2014-06-26 17:06:27,031::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721091::DEBUG::2014-06-26 17:06:27,032::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`864287a7-731a-4f36-9d0f-c0ced469300c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721091::DEBUG::2014-06-26 17:06:27,032::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721091::DEBUG::2014-06-26 17:06:27,032::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721091::DEBUG::2014-06-26 17:06:27,032::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`864287a7-731a-4f36-9d0f-c0ced469300c`::Granted request >Thread-721091::DEBUG::2014-06-26 17:06:27,032::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cda51861-e316-4266-8efd-a87d7f2896e8`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721091::DEBUG::2014-06-26 17:06:27,032::task::993::Storage.TaskManager.Task::(_decref) Task=`cda51861-e316-4266-8efd-a87d7f2896e8`::ref 1 aborting False >Thread-721091::INFO::2014-06-26 17:06:27,035::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721091::DEBUG::2014-06-26 17:06:27,035::task::1191::Storage.TaskManager.Task::(prepare) Task=`cda51861-e316-4266-8efd-a87d7f2896e8`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721091::DEBUG::2014-06-26 17:06:27,035::task::595::Storage.TaskManager.Task::(_updateState) Task=`cda51861-e316-4266-8efd-a87d7f2896e8`::moving from state preparing -> state finished >Thread-721091::DEBUG::2014-06-26 17:06:27,035::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721091::DEBUG::2014-06-26 17:06:27,035::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721091::DEBUG::2014-06-26 17:06:27,035::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721091::DEBUG::2014-06-26 17:06:27,035::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721091::DEBUG::2014-06-26 17:06:27,035::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721091::DEBUG::2014-06-26 17:06:27,035::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721091::DEBUG::2014-06-26 17:06:27,036::task::993::Storage.TaskManager.Task::(_decref) Task=`cda51861-e316-4266-8efd-a87d7f2896e8`::ref 0 aborting False >Thread-721091::DEBUG::2014-06-26 17:06:27,036::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:06:27,315::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:06:27,324::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000967484 s, 406 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:06:28,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:28,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011626 s, 88.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:28,643::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:28,644::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:28,644::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:28,645::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:28,645::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:28,646::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721092::DEBUG::2014-06-26 17:06:28,648::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:06:28,648::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721092::DEBUG::2014-06-26 17:06:28,651::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:06:30,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:30,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178775 s, 57.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:31,667::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:31,672::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:31,673::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:31,673::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:31,673::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:31,673::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:31,674::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721093::DEBUG::2014-06-26 17:06:31,674::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721093::DEBUG::2014-06-26 17:06:31,675::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:06:32,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:32,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116617 s, 87.8 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:06:34,516::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:06:34,523::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000335842 s, 1.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:34,684::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:34,684::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:34,684::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:34,684::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:34,685::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:34,685::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:34,685::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721094::DEBUG::2014-06-26 17:06:34,685::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721094::DEBUG::2014-06-26 17:06:34,686::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:06:34,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:34,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119613 s, 85.6 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:06:36,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:36,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0214904 s, 47.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:37,062::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:37,063::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:37,063::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:37,064::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:37,064::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:37,065::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721095::DEBUG::2014-06-26 17:06:37,067::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:06:37,067::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721095::DEBUG::2014-06-26 17:06:37,070::task::595::Storage.TaskManager.Task::(_updateState) Task=`07554c11-3d87-4fa4-95d9-7c4a3cea2ee8`::moving from state init -> state preparing >Thread-721095::INFO::2014-06-26 17:06:37,071::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721095::INFO::2014-06-26 17:06:37,072::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721095::DEBUG::2014-06-26 17:06:37,072::task::1191::Storage.TaskManager.Task::(prepare) Task=`07554c11-3d87-4fa4-95d9-7c4a3cea2ee8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721095::DEBUG::2014-06-26 17:06:37,073::task::595::Storage.TaskManager.Task::(_updateState) Task=`07554c11-3d87-4fa4-95d9-7c4a3cea2ee8`::moving from state preparing -> state finished >Thread-721095::DEBUG::2014-06-26 17:06:37,073::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721095::DEBUG::2014-06-26 17:06:37,073::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721095::DEBUG::2014-06-26 17:06:37,074::task::993::Storage.TaskManager.Task::(_decref) Task=`07554c11-3d87-4fa4-95d9-7c4a3cea2ee8`::ref 0 aborting False >Thread-721095::DEBUG::2014-06-26 17:06:37,075::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:37,091::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:37,092::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:37,092::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:37,093::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:37,094::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:37,095::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721096::DEBUG::2014-06-26 17:06:37,096::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:06:37,096::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721096::DEBUG::2014-06-26 17:06:37,099::task::595::Storage.TaskManager.Task::(_updateState) Task=`4a37b67a-d250-441d-b6c2-aad3b5f3f09c`::moving from state init -> state preparing >Thread-721096::INFO::2014-06-26 17:06:37,099::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721096::DEBUG::2014-06-26 17:06:37,101::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`ac344da8-4d8b-4b2c-bc16-059811a48fc9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721096::DEBUG::2014-06-26 17:06:37,101::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721096::DEBUG::2014-06-26 17:06:37,102::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721096::DEBUG::2014-06-26 17:06:37,103::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`ac344da8-4d8b-4b2c-bc16-059811a48fc9`::Granted request >Thread-721096::DEBUG::2014-06-26 17:06:37,104::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4a37b67a-d250-441d-b6c2-aad3b5f3f09c`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721096::DEBUG::2014-06-26 17:06:37,105::task::993::Storage.TaskManager.Task::(_decref) Task=`4a37b67a-d250-441d-b6c2-aad3b5f3f09c`::ref 1 aborting False >Thread-721096::INFO::2014-06-26 17:06:37,117::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721096::DEBUG::2014-06-26 17:06:37,118::task::1191::Storage.TaskManager.Task::(prepare) Task=`4a37b67a-d250-441d-b6c2-aad3b5f3f09c`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721096::DEBUG::2014-06-26 17:06:37,118::task::595::Storage.TaskManager.Task::(_updateState) Task=`4a37b67a-d250-441d-b6c2-aad3b5f3f09c`::moving from state preparing -> state finished >Thread-721096::DEBUG::2014-06-26 17:06:37,119::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721096::DEBUG::2014-06-26 17:06:37,119::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721096::DEBUG::2014-06-26 17:06:37,120::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721096::DEBUG::2014-06-26 17:06:37,121::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721096::DEBUG::2014-06-26 17:06:37,121::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721096::DEBUG::2014-06-26 17:06:37,122::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721096::DEBUG::2014-06-26 17:06:37,122::task::993::Storage.TaskManager.Task::(_decref) Task=`4a37b67a-d250-441d-b6c2-aad3b5f3f09c`::ref 0 aborting False >Thread-721096::DEBUG::2014-06-26 17:06:37,125::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:06:37,326::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767 >Thread-123053::DEBUG::2014-06-26 17:06:37,341::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767 >Thread-123053::DEBUG::2014-06-26 17:06:37,343::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-123053::DEBUG::2014-06-26 17:06:37,345::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISO_DOMAIN', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00161ead-084f-42e0-bbdf-6be74f182a50', 'REMOTE_PATH=pb-rh35.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140616114208', 'ROLE=Regular', 'SDUUID=9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=32a5a6165ec7c85578dcde10da95cc8a94201d29'] >Thread-123053::DEBUG::2014-06-26 17:06:37,348::fileSD::619::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-123053::INFO::2014-06-26 17:06:37,349::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767_imageNS already registered >Thread-123053::INFO::2014-06-26 17:06:37,349::sd::391::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767_volumeNS already registered >Thread-123053::DEBUG::2014-06-26 17:06:37,351::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:06:37,358::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.00039707 s, 990 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:37,697::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:37,697::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:37,697::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:37,697::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:37,697::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:37,698::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:37,698::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721101::DEBUG::2014-06-26 17:06:37,698::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721101::DEBUG::2014-06-26 17:06:37,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fd6a786-f9cc-49cd-9969-4dc225333d7c`::moving from state init -> state preparing >Thread-721101::INFO::2014-06-26 17:06:37,700::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721101::INFO::2014-06-26 17:06:37,700::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00039707', 'lastCheck': '0.3', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000335842', 'lastCheck': '3.2', 'valid': True}} >Thread-721101::DEBUG::2014-06-26 17:06:37,700::task::1191::Storage.TaskManager.Task::(prepare) Task=`8fd6a786-f9cc-49cd-9969-4dc225333d7c`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00039707', 'lastCheck': '0.3', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000335842', 'lastCheck': '3.2', 'valid': True}} >Thread-721101::DEBUG::2014-06-26 17:06:37,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fd6a786-f9cc-49cd-9969-4dc225333d7c`::moving from state preparing -> state finished >Thread-721101::DEBUG::2014-06-26 17:06:37,700::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721101::DEBUG::2014-06-26 17:06:37,700::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721101::DEBUG::2014-06-26 17:06:37,700::task::993::Storage.TaskManager.Task::(_decref) Task=`8fd6a786-f9cc-49cd-9969-4dc225333d7c`::ref 0 aborting False >Thread-721101::DEBUG::2014-06-26 17:06:37,703::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:37,734::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:37,734::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:37,735::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:37,735::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:37,735::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:37,735::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:37,735::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721102::DEBUG::2014-06-26 17:06:37,735::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721102::DEBUG::2014-06-26 17:06:37,736::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:06:39,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:39,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116701 s, 87.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:40,771::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:40,771::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:40,772::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:40,772::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:40,772::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:40,772::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721103::DEBUG::2014-06-26 17:06:40,773::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:06:40,773::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721103::DEBUG::2014-06-26 17:06:40,774::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:06:41,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:41,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120962 s, 84.7 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:06:43,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:43,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119954 s, 85.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:43,786::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:43,786::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:43,786::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:43,786::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:43,787::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:43,787::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721104::DEBUG::2014-06-26 17:06:43,787::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:06:43,787::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721104::DEBUG::2014-06-26 17:06:43,789::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:06:44,526::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:06:44,533::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000220345 s, 2.5 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:06:45,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:45,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116753 s, 87.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:46,800::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:46,800::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:46,800::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:46,801::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:46,801::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:46,801::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:46,802::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721105::DEBUG::2014-06-26 17:06:46,802::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721105::DEBUG::2014-06-26 17:06:46,803::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:47,153::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:47,153::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:47,153::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:47,153::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:47,153::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:47,153::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721106::DEBUG::2014-06-26 17:06:47,154::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:06:47,154::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721106::DEBUG::2014-06-26 17:06:47,155::task::595::Storage.TaskManager.Task::(_updateState) Task=`914b81df-942f-427b-8450-3f1da94ab661`::moving from state init -> state preparing >Thread-721106::INFO::2014-06-26 17:06:47,155::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721106::INFO::2014-06-26 17:06:47,155::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721106::DEBUG::2014-06-26 17:06:47,155::task::1191::Storage.TaskManager.Task::(prepare) Task=`914b81df-942f-427b-8450-3f1da94ab661`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721106::DEBUG::2014-06-26 17:06:47,155::task::595::Storage.TaskManager.Task::(_updateState) Task=`914b81df-942f-427b-8450-3f1da94ab661`::moving from state preparing -> state finished >Thread-721106::DEBUG::2014-06-26 17:06:47,155::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721106::DEBUG::2014-06-26 17:06:47,156::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721106::DEBUG::2014-06-26 17:06:47,156::task::993::Storage.TaskManager.Task::(_decref) Task=`914b81df-942f-427b-8450-3f1da94ab661`::ref 0 aborting False >Thread-721106::DEBUG::2014-06-26 17:06:47,156::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:47,173::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:47,173::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:47,174::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:47,174::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:47,174::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:47,174::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:47,174::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721107::DEBUG::2014-06-26 17:06:47,174::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721107::DEBUG::2014-06-26 17:06:47,175::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d186da7-9874-46f5-94ab-b04495e9ef53`::moving from state init -> state preparing >Thread-721107::INFO::2014-06-26 17:06:47,175::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721107::DEBUG::2014-06-26 17:06:47,176::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`6b2152ea-6899-4fb4-80c4-2ab20555d5c6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721107::DEBUG::2014-06-26 17:06:47,176::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721107::DEBUG::2014-06-26 17:06:47,176::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721107::DEBUG::2014-06-26 17:06:47,176::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`6b2152ea-6899-4fb4-80c4-2ab20555d5c6`::Granted request >Thread-721107::DEBUG::2014-06-26 17:06:47,176::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4d186da7-9874-46f5-94ab-b04495e9ef53`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721107::DEBUG::2014-06-26 17:06:47,176::task::993::Storage.TaskManager.Task::(_decref) Task=`4d186da7-9874-46f5-94ab-b04495e9ef53`::ref 1 aborting False >Thread-721107::INFO::2014-06-26 17:06:47,179::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721107::DEBUG::2014-06-26 17:06:47,179::task::1191::Storage.TaskManager.Task::(prepare) Task=`4d186da7-9874-46f5-94ab-b04495e9ef53`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721107::DEBUG::2014-06-26 17:06:47,179::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d186da7-9874-46f5-94ab-b04495e9ef53`::moving from state preparing -> state finished >Thread-721107::DEBUG::2014-06-26 17:06:47,179::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721107::DEBUG::2014-06-26 17:06:47,179::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721107::DEBUG::2014-06-26 17:06:47,179::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721107::DEBUG::2014-06-26 17:06:47,179::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721107::DEBUG::2014-06-26 17:06:47,179::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721107::DEBUG::2014-06-26 17:06:47,180::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721107::DEBUG::2014-06-26 17:06:47,180::task::993::Storage.TaskManager.Task::(_decref) Task=`4d186da7-9874-46f5-94ab-b04495e9ef53`::ref 0 aborting False >Thread-721107::DEBUG::2014-06-26 17:06:47,180::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:06:47,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:47,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118621 s, 86.3 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:06:47,361::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:06:47,368::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000516712 s, 761 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:06:49,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:49,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116096 s, 88.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:49,814::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:49,815::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:49,815::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:49,815::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:49,815::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:49,815::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721108::DEBUG::2014-06-26 17:06:49,816::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:06:49,816::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721108::DEBUG::2014-06-26 17:06:49,817::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:06:51,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:51,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117596 s, 87.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:52,830::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:52,830::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:52,830::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:52,830::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:52,830::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:52,830::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721109::DEBUG::2014-06-26 17:06:52,831::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:06:52,831::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721109::DEBUG::2014-06-26 17:06:52,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c6dce9e-449a-4a38-9a1c-343a22f123ae`::moving from state init -> state preparing >Thread-721109::INFO::2014-06-26 17:06:52,833::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721109::INFO::2014-06-26 17:06:52,833::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000516712', 'lastCheck': '5.5', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000220345', 'lastCheck': '8.3', 'valid': True}} >Thread-721109::DEBUG::2014-06-26 17:06:52,833::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c6dce9e-449a-4a38-9a1c-343a22f123ae`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000516712', 'lastCheck': '5.5', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000220345', 'lastCheck': '8.3', 'valid': True}} >Thread-721109::DEBUG::2014-06-26 17:06:52,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c6dce9e-449a-4a38-9a1c-343a22f123ae`::moving from state preparing -> state finished >Thread-721109::DEBUG::2014-06-26 17:06:52,833::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721109::DEBUG::2014-06-26 17:06:52,833::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721109::DEBUG::2014-06-26 17:06:52,833::task::993::Storage.TaskManager.Task::(_decref) Task=`9c6dce9e-449a-4a38-9a1c-343a22f123ae`::ref 0 aborting False >Thread-721109::DEBUG::2014-06-26 17:06:52,835::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:52,888::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:52,888::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:52,888::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:52,888::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:52,889::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:52,889::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:52,889::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721110::DEBUG::2014-06-26 17:06:52,889::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721110::DEBUG::2014-06-26 17:06:52,890::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:06:53,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:53,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118769 s, 86.2 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:06:54,535::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:06:54,541::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000309919 s, 1.8 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:06:55,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:55,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119041 s, 86.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:55,922::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:55,922::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:55,923::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:55,923::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:55,923::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:55,923::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:55,924::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721111::DEBUG::2014-06-26 17:06:55,924::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721111::DEBUG::2014-06-26 17:06:55,925::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:57,204::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:57,204::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:57,204::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:57,205::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:57,205::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:57,205::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:57,205::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721112::DEBUG::2014-06-26 17:06:57,205::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721112::DEBUG::2014-06-26 17:06:57,206::task::595::Storage.TaskManager.Task::(_updateState) Task=`17aaf7ba-5e3a-40bb-b120-580071b5b2b8`::moving from state init -> state preparing >Thread-721112::INFO::2014-06-26 17:06:57,206::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721112::INFO::2014-06-26 17:06:57,207::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721112::DEBUG::2014-06-26 17:06:57,207::task::1191::Storage.TaskManager.Task::(prepare) Task=`17aaf7ba-5e3a-40bb-b120-580071b5b2b8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721112::DEBUG::2014-06-26 17:06:57,207::task::595::Storage.TaskManager.Task::(_updateState) Task=`17aaf7ba-5e3a-40bb-b120-580071b5b2b8`::moving from state preparing -> state finished >Thread-721112::DEBUG::2014-06-26 17:06:57,207::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721112::DEBUG::2014-06-26 17:06:57,207::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721112::DEBUG::2014-06-26 17:06:57,207::task::993::Storage.TaskManager.Task::(_decref) Task=`17aaf7ba-5e3a-40bb-b120-580071b5b2b8`::ref 0 aborting False >Thread-721112::DEBUG::2014-06-26 17:06:57,207::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:57,225::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:57,225::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:57,225::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:57,225::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:57,226::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:57,226::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:57,226::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721113::DEBUG::2014-06-26 17:06:57,226::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721113::DEBUG::2014-06-26 17:06:57,227::task::595::Storage.TaskManager.Task::(_updateState) Task=`80548bf2-bb48-45c4-a43e-1f7785378a86`::moving from state init -> state preparing >Thread-721113::INFO::2014-06-26 17:06:57,227::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721113::DEBUG::2014-06-26 17:06:57,227::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`5be50647-416e-4a49-b975-cff784c2eb1b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721113::DEBUG::2014-06-26 17:06:57,227::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721113::DEBUG::2014-06-26 17:06:57,228::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721113::DEBUG::2014-06-26 17:06:57,228::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`5be50647-416e-4a49-b975-cff784c2eb1b`::Granted request >Thread-721113::DEBUG::2014-06-26 17:06:57,228::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`80548bf2-bb48-45c4-a43e-1f7785378a86`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721113::DEBUG::2014-06-26 17:06:57,228::task::993::Storage.TaskManager.Task::(_decref) Task=`80548bf2-bb48-45c4-a43e-1f7785378a86`::ref 1 aborting False >Thread-721113::INFO::2014-06-26 17:06:57,230::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721113::DEBUG::2014-06-26 17:06:57,230::task::1191::Storage.TaskManager.Task::(prepare) Task=`80548bf2-bb48-45c4-a43e-1f7785378a86`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721113::DEBUG::2014-06-26 17:06:57,230::task::595::Storage.TaskManager.Task::(_updateState) Task=`80548bf2-bb48-45c4-a43e-1f7785378a86`::moving from state preparing -> state finished >Thread-721113::DEBUG::2014-06-26 17:06:57,230::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721113::DEBUG::2014-06-26 17:06:57,231::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721113::DEBUG::2014-06-26 17:06:57,231::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721113::DEBUG::2014-06-26 17:06:57,231::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721113::DEBUG::2014-06-26 17:06:57,231::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721113::DEBUG::2014-06-26 17:06:57,231::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721113::DEBUG::2014-06-26 17:06:57,231::task::993::Storage.TaskManager.Task::(_decref) Task=`80548bf2-bb48-45c4-a43e-1f7785378a86`::ref 0 aborting False >Thread-721113::DEBUG::2014-06-26 17:06:57,232::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:06:57,372::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:06:57,379::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.00052395 s, 750 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:06:57,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:57,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116442 s, 87.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:58,936::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:58,936::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:58,936::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:06:58,936::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:06:58,937::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:06:58,937::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:06:58,938::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721114::DEBUG::2014-06-26 17:06:58,938::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721114::DEBUG::2014-06-26 17:06:58,939::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:06:59,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:06:59,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120697 s, 84.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:00,736::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:00,736::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:00,736::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:00,736::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:00,736::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:00,737::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:00,737::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721115::DEBUG::2014-06-26 17:07:00,737::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Volume_extendSize' in bridge >Thread-721115::DEBUG::2014-06-26 17:07:00,738::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:01,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:01,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117433 s, 87.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:01,951::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:01,951::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:01,951::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:01,951::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:01,951::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:01,952::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:01,952::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721116::DEBUG::2014-06-26 17:07:01,952::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721116::DEBUG::2014-06-26 17:07:01,953::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:03,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:03,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120376 s, 85.1 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:07:04,544::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:07:04,550::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000330389 s, 1.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:04,964::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:04,964::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:04,964::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:04,964::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:04,965::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:04,965::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:04,965::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721117::DEBUG::2014-06-26 17:07:04,965::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721117::DEBUG::2014-06-26 17:07:04,967::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:05,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:05,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120619 s, 84.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:07,262::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:07,263::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:07,263::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:07,264::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:07,264::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:07,265::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721118::DEBUG::2014-06-26 17:07:07,267::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:07:07,267::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721118::DEBUG::2014-06-26 17:07:07,270::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9030ef3-3e12-4881-ad70-865fa93ac8b6`::moving from state init -> state preparing >Thread-721118::INFO::2014-06-26 17:07:07,270::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721118::INFO::2014-06-26 17:07:07,271::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721118::DEBUG::2014-06-26 17:07:07,272::task::1191::Storage.TaskManager.Task::(prepare) Task=`a9030ef3-3e12-4881-ad70-865fa93ac8b6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721118::DEBUG::2014-06-26 17:07:07,272::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9030ef3-3e12-4881-ad70-865fa93ac8b6`::moving from state preparing -> state finished >Thread-721118::DEBUG::2014-06-26 17:07:07,273::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721118::DEBUG::2014-06-26 17:07:07,273::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721118::DEBUG::2014-06-26 17:07:07,274::task::993::Storage.TaskManager.Task::(_decref) Task=`a9030ef3-3e12-4881-ad70-865fa93ac8b6`::ref 0 aborting False >Thread-721118::DEBUG::2014-06-26 17:07:07,275::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:07,291::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:07,291::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:07,291::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:07,292::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:07,293::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:07,293::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721119::DEBUG::2014-06-26 17:07:07,295::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:07:07,295::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721119::DEBUG::2014-06-26 17:07:07,298::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba20562d-2c94-41bc-a4f1-85e420daf89e`::moving from state init -> state preparing >Thread-721119::INFO::2014-06-26 17:07:07,298::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721119::DEBUG::2014-06-26 17:07:07,300::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`0ab9bca9-1ca4-4618-902c-7527aafea391`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721119::DEBUG::2014-06-26 17:07:07,300::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721119::DEBUG::2014-06-26 17:07:07,301::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721119::DEBUG::2014-06-26 17:07:07,301::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`0ab9bca9-1ca4-4618-902c-7527aafea391`::Granted request >Thread-721119::DEBUG::2014-06-26 17:07:07,302::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ba20562d-2c94-41bc-a4f1-85e420daf89e`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721119::DEBUG::2014-06-26 17:07:07,303::task::993::Storage.TaskManager.Task::(_decref) Task=`ba20562d-2c94-41bc-a4f1-85e420daf89e`::ref 1 aborting False >Thread-721119::INFO::2014-06-26 17:07:07,313::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721119::DEBUG::2014-06-26 17:07:07,314::task::1191::Storage.TaskManager.Task::(prepare) Task=`ba20562d-2c94-41bc-a4f1-85e420daf89e`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721119::DEBUG::2014-06-26 17:07:07,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba20562d-2c94-41bc-a4f1-85e420daf89e`::moving from state preparing -> state finished >Thread-721119::DEBUG::2014-06-26 17:07:07,315::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721119::DEBUG::2014-06-26 17:07:07,315::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721119::DEBUG::2014-06-26 17:07:07,316::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721119::DEBUG::2014-06-26 17:07:07,317::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721119::DEBUG::2014-06-26 17:07:07,317::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721119::DEBUG::2014-06-26 17:07:07,317::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721119::DEBUG::2014-06-26 17:07:07,318::task::993::Storage.TaskManager.Task::(_decref) Task=`ba20562d-2c94-41bc-a4f1-85e420daf89e`::ref 0 aborting False >Thread-721119::DEBUG::2014-06-26 17:07:07,321::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:07:07,381::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:07:07,388::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000528046 s, 744 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:07:07,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:07,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117921 s, 86.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:07,976::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:07,976::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:07,976::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:07,976::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:07,976::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:07,977::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721120::DEBUG::2014-06-26 17:07:07,977::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:07:07,977::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721120::DEBUG::2014-06-26 17:07:07,979::task::595::Storage.TaskManager.Task::(_updateState) Task=`2cfdf542-8d27-4706-a282-69ca3efce026`::moving from state init -> state preparing >Thread-721120::INFO::2014-06-26 17:07:07,979::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721120::INFO::2014-06-26 17:07:07,979::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000528046', 'lastCheck': '0.6', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000330389', 'lastCheck': '3.4', 'valid': True}} >Thread-721120::DEBUG::2014-06-26 17:07:07,979::task::1191::Storage.TaskManager.Task::(prepare) Task=`2cfdf542-8d27-4706-a282-69ca3efce026`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000528046', 'lastCheck': '0.6', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000330389', 'lastCheck': '3.4', 'valid': True}} >Thread-721120::DEBUG::2014-06-26 17:07:07,979::task::595::Storage.TaskManager.Task::(_updateState) Task=`2cfdf542-8d27-4706-a282-69ca3efce026`::moving from state preparing -> state finished >Thread-721120::DEBUG::2014-06-26 17:07:07,979::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721120::DEBUG::2014-06-26 17:07:07,979::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721120::DEBUG::2014-06-26 17:07:07,980::task::993::Storage.TaskManager.Task::(_decref) Task=`2cfdf542-8d27-4706-a282-69ca3efce026`::ref 0 aborting False >Thread-721120::DEBUG::2014-06-26 17:07:07,982::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:08,018::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:08,018::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:08,018::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:08,018::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:08,018::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:08,019::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:08,019::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721121::DEBUG::2014-06-26 17:07:08,019::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721121::DEBUG::2014-06-26 17:07:08,020::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:09,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:09,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118907 s, 86.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:11,053::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:11,053::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:11,053::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:11,053::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:11,053::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:11,054::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721122::DEBUG::2014-06-26 17:07:11,054::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:07:11,054::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721122::DEBUG::2014-06-26 17:07:11,055::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:11,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:11,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112743 s, 90.8 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:07:13,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:13,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118794 s, 86.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:14,068::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:14,068::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:14,068::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:14,068::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:14,069::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:14,069::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:14,069::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721123::DEBUG::2014-06-26 17:07:14,069::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721123::DEBUG::2014-06-26 17:07:14,070::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:07:14,553::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:07:14,559::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000265666 s, 2.1 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:07:15,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:15,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117848 s, 86.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:17,082::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:17,082::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:17,082::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:17,082::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:17,082::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:17,083::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721124::DEBUG::2014-06-26 17:07:17,083::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:07:17,083::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721124::DEBUG::2014-06-26 17:07:17,084::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:17,345::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:17,345::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:17,346::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:17,346::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:17,346::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:17,346::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:17,346::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721125::DEBUG::2014-06-26 17:07:17,346::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721125::DEBUG::2014-06-26 17:07:17,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`83c6a8a0-a9a5-4ad7-aaa7-cd76308398c9`::moving from state init -> state preparing >Thread-721125::INFO::2014-06-26 17:07:17,347::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721125::INFO::2014-06-26 17:07:17,348::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721125::DEBUG::2014-06-26 17:07:17,348::task::1191::Storage.TaskManager.Task::(prepare) Task=`83c6a8a0-a9a5-4ad7-aaa7-cd76308398c9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721125::DEBUG::2014-06-26 17:07:17,348::task::595::Storage.TaskManager.Task::(_updateState) Task=`83c6a8a0-a9a5-4ad7-aaa7-cd76308398c9`::moving from state preparing -> state finished >Thread-721125::DEBUG::2014-06-26 17:07:17,348::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721125::DEBUG::2014-06-26 17:07:17,348::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721125::DEBUG::2014-06-26 17:07:17,348::task::993::Storage.TaskManager.Task::(_decref) Task=`83c6a8a0-a9a5-4ad7-aaa7-cd76308398c9`::ref 0 aborting False >Thread-721125::DEBUG::2014-06-26 17:07:17,348::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:17,362::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:17,363::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:17,363::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:17,363::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:17,363::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:17,363::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:17,363::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721126::DEBUG::2014-06-26 17:07:17,363::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721126::DEBUG::2014-06-26 17:07:17,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ce43f16-88bb-4cbe-a2b7-9d648f394340`::moving from state init -> state preparing >Thread-721126::INFO::2014-06-26 17:07:17,364::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721126::DEBUG::2014-06-26 17:07:17,365::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`269037fc-372e-4181-803d-91cb60171460`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721126::DEBUG::2014-06-26 17:07:17,365::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721126::DEBUG::2014-06-26 17:07:17,366::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721126::DEBUG::2014-06-26 17:07:17,366::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`269037fc-372e-4181-803d-91cb60171460`::Granted request >Thread-721126::DEBUG::2014-06-26 17:07:17,366::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7ce43f16-88bb-4cbe-a2b7-9d648f394340`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721126::DEBUG::2014-06-26 17:07:17,366::task::993::Storage.TaskManager.Task::(_decref) Task=`7ce43f16-88bb-4cbe-a2b7-9d648f394340`::ref 1 aborting False >Thread-721126::INFO::2014-06-26 17:07:17,368::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721126::DEBUG::2014-06-26 17:07:17,368::task::1191::Storage.TaskManager.Task::(prepare) Task=`7ce43f16-88bb-4cbe-a2b7-9d648f394340`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721126::DEBUG::2014-06-26 17:07:17,369::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ce43f16-88bb-4cbe-a2b7-9d648f394340`::moving from state preparing -> state finished >Thread-721126::DEBUG::2014-06-26 17:07:17,369::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721126::DEBUG::2014-06-26 17:07:17,369::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721126::DEBUG::2014-06-26 17:07:17,369::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721126::DEBUG::2014-06-26 17:07:17,369::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721126::DEBUG::2014-06-26 17:07:17,369::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721126::DEBUG::2014-06-26 17:07:17,369::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721126::DEBUG::2014-06-26 17:07:17,369::task::993::Storage.TaskManager.Task::(_decref) Task=`7ce43f16-88bb-4cbe-a2b7-9d648f394340`::ref 0 aborting False >Thread-721126::DEBUG::2014-06-26 17:07:17,370::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:07:17,390::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:07:17,398::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.00140085 s, 281 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:07:17,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:18,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113013 s, 90.6 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:07:20,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:20,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118441 s, 86.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:20,094::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:20,095::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:20,095::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:20,095::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:20,095::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:20,095::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721127::DEBUG::2014-06-26 17:07:20,096::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:07:20,096::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721127::DEBUG::2014-06-26 17:07:20,097::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:22,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:22,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115867 s, 88.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:23,107::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:23,107::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:23,107::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:23,107::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:23,108::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:23,108::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:23,108::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721128::DEBUG::2014-06-26 17:07:23,108::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721128::DEBUG::2014-06-26 17:07:23,110::task::595::Storage.TaskManager.Task::(_updateState) Task=`a90e770c-e77c-4869-9537-4ac8dc45b1be`::moving from state init -> state preparing >Thread-721128::INFO::2014-06-26 17:07:23,110::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721128::INFO::2014-06-26 17:07:23,110::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00140085', 'lastCheck': '5.7', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000265666', 'lastCheck': '8.5', 'valid': True}} >Thread-721128::DEBUG::2014-06-26 17:07:23,110::task::1191::Storage.TaskManager.Task::(prepare) Task=`a90e770c-e77c-4869-9537-4ac8dc45b1be`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00140085', 'lastCheck': '5.7', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000265666', 'lastCheck': '8.5', 'valid': True}} >Thread-721128::DEBUG::2014-06-26 17:07:23,110::task::595::Storage.TaskManager.Task::(_updateState) Task=`a90e770c-e77c-4869-9537-4ac8dc45b1be`::moving from state preparing -> state finished >Thread-721128::DEBUG::2014-06-26 17:07:23,110::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721128::DEBUG::2014-06-26 17:07:23,110::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721128::DEBUG::2014-06-26 17:07:23,111::task::993::Storage.TaskManager.Task::(_decref) Task=`a90e770c-e77c-4869-9537-4ac8dc45b1be`::ref 0 aborting False >Thread-721128::DEBUG::2014-06-26 17:07:23,113::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:23,146::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:23,146::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:23,147::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:23,147::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:23,147::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:23,147::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:23,148::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721129::DEBUG::2014-06-26 17:07:23,148::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721129::DEBUG::2014-06-26 17:07:23,148::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:24,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:24,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011685 s, 87.6 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:07:24,562::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:07:24,569::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000241601 s, 2.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:26,183::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:26,183::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:26,183::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:26,184::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:26,184::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:26,184::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:26,185::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721130::DEBUG::2014-06-26 17:07:26,185::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721130::DEBUG::2014-06-26 17:07:26,186::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:26,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:26,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118421 s, 86.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:27,316::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:27,316::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:27,316::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:27,316::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:27,317::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:27,317::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:27,318::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721131::DEBUG::2014-06-26 17:07:27,318::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Volume_extendSize' in bridge >Thread-721131::DEBUG::2014-06-26 17:07:27,318::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:27,394::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:27,394::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:27,395::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:27,395::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:27,395::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:27,395::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:27,395::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721132::DEBUG::2014-06-26 17:07:27,395::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721132::DEBUG::2014-06-26 17:07:27,396::task::595::Storage.TaskManager.Task::(_updateState) Task=`29c7257f-f468-4914-8131-f812b0b89a38`::moving from state init -> state preparing >Thread-721132::INFO::2014-06-26 17:07:27,397::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721132::INFO::2014-06-26 17:07:27,397::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721132::DEBUG::2014-06-26 17:07:27,397::task::1191::Storage.TaskManager.Task::(prepare) Task=`29c7257f-f468-4914-8131-f812b0b89a38`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721132::DEBUG::2014-06-26 17:07:27,397::task::595::Storage.TaskManager.Task::(_updateState) Task=`29c7257f-f468-4914-8131-f812b0b89a38`::moving from state preparing -> state finished >Thread-721132::DEBUG::2014-06-26 17:07:27,397::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721132::DEBUG::2014-06-26 17:07:27,397::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721132::DEBUG::2014-06-26 17:07:27,397::task::993::Storage.TaskManager.Task::(_decref) Task=`29c7257f-f468-4914-8131-f812b0b89a38`::ref 0 aborting False >Thread-721132::DEBUG::2014-06-26 17:07:27,398::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:07:27,401::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:07:27,409::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.00130991 s, 300 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:27,413::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:27,413::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:27,413::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:27,413::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:27,414::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:27,414::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:27,414::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721133::DEBUG::2014-06-26 17:07:27,414::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721133::DEBUG::2014-06-26 17:07:27,415::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d291253-e737-4b58-92eb-b942720c4266`::moving from state init -> state preparing >Thread-721133::INFO::2014-06-26 17:07:27,416::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721133::DEBUG::2014-06-26 17:07:27,416::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`f8f85635-d4d5-41a2-9395-db1ab3274275`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721133::DEBUG::2014-06-26 17:07:27,416::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721133::DEBUG::2014-06-26 17:07:27,416::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721133::DEBUG::2014-06-26 17:07:27,416::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`f8f85635-d4d5-41a2-9395-db1ab3274275`::Granted request >Thread-721133::DEBUG::2014-06-26 17:07:27,417::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2d291253-e737-4b58-92eb-b942720c4266`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721133::DEBUG::2014-06-26 17:07:27,417::task::993::Storage.TaskManager.Task::(_decref) Task=`2d291253-e737-4b58-92eb-b942720c4266`::ref 1 aborting False >Thread-721133::INFO::2014-06-26 17:07:27,419::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721133::DEBUG::2014-06-26 17:07:27,419::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d291253-e737-4b58-92eb-b942720c4266`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721133::DEBUG::2014-06-26 17:07:27,419::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d291253-e737-4b58-92eb-b942720c4266`::moving from state preparing -> state finished >Thread-721133::DEBUG::2014-06-26 17:07:27,419::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721133::DEBUG::2014-06-26 17:07:27,419::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721133::DEBUG::2014-06-26 17:07:27,420::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721133::DEBUG::2014-06-26 17:07:27,420::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721133::DEBUG::2014-06-26 17:07:27,420::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721133::DEBUG::2014-06-26 17:07:27,420::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721133::DEBUG::2014-06-26 17:07:27,420::task::993::Storage.TaskManager.Task::(_decref) Task=`2d291253-e737-4b58-92eb-b942720c4266`::ref 0 aborting False >Thread-721133::DEBUG::2014-06-26 17:07:27,420::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:28,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:28,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114928 s, 89.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:29,201::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:29,202::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:29,202::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:29,202::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:29,202::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:29,202::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721134::DEBUG::2014-06-26 17:07:29,203::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:07:29,203::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721134::DEBUG::2014-06-26 17:07:29,204::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:30,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:30,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0140961 s, 72.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:32,219::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:32,219::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:32,219::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:32,219::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:32,219::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:32,219::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:32,220::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721135::DEBUG::2014-06-26 17:07:32,220::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721135::DEBUG::2014-06-26 17:07:32,221::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:32,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:32,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120334 s, 85.1 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:07:34,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:34,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119677 s, 85.6 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:07:34,571::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:07:34,578::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000314804 s, 1.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:35,234::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:35,234::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:35,234::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:35,234::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:35,235::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:35,235::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:35,235::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721136::DEBUG::2014-06-26 17:07:35,236::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721136::DEBUG::2014-06-26 17:07:35,237::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:36,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:36,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0219349 s, 46.7 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:07:37,411::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:07:37,418::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000496682 s, 791 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:37,446::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:37,446::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:37,446::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:37,446::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:37,447::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:37,447::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:37,448::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721137::DEBUG::2014-06-26 17:07:37,448::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721137::DEBUG::2014-06-26 17:07:37,449::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9835c86-0d53-405e-8f50-a5863589e008`::moving from state init -> state preparing >Thread-721137::INFO::2014-06-26 17:07:37,449::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721137::INFO::2014-06-26 17:07:37,449::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721137::DEBUG::2014-06-26 17:07:37,449::task::1191::Storage.TaskManager.Task::(prepare) Task=`c9835c86-0d53-405e-8f50-a5863589e008`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721137::DEBUG::2014-06-26 17:07:37,449::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9835c86-0d53-405e-8f50-a5863589e008`::moving from state preparing -> state finished >Thread-721137::DEBUG::2014-06-26 17:07:37,449::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721137::DEBUG::2014-06-26 17:07:37,449::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721137::DEBUG::2014-06-26 17:07:37,449::task::993::Storage.TaskManager.Task::(_decref) Task=`c9835c86-0d53-405e-8f50-a5863589e008`::ref 0 aborting False >Thread-721137::DEBUG::2014-06-26 17:07:37,450::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:37,464::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:37,464::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:37,464::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:37,464::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:37,464::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:37,465::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:37,465::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721138::DEBUG::2014-06-26 17:07:37,465::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721138::DEBUG::2014-06-26 17:07:37,466::task::595::Storage.TaskManager.Task::(_updateState) Task=`09a1e0e7-9ab9-4a84-bc59-f31392db0618`::moving from state init -> state preparing >Thread-721138::INFO::2014-06-26 17:07:37,466::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721138::DEBUG::2014-06-26 17:07:37,466::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`37bd29fc-05d4-4d7e-8bf5-c8178d3b5db3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721138::DEBUG::2014-06-26 17:07:37,466::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721138::DEBUG::2014-06-26 17:07:37,467::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721138::DEBUG::2014-06-26 17:07:37,467::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`37bd29fc-05d4-4d7e-8bf5-c8178d3b5db3`::Granted request >Thread-721138::DEBUG::2014-06-26 17:07:37,467::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`09a1e0e7-9ab9-4a84-bc59-f31392db0618`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721138::DEBUG::2014-06-26 17:07:37,467::task::993::Storage.TaskManager.Task::(_decref) Task=`09a1e0e7-9ab9-4a84-bc59-f31392db0618`::ref 1 aborting False >Thread-721138::INFO::2014-06-26 17:07:37,469::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721138::DEBUG::2014-06-26 17:07:37,469::task::1191::Storage.TaskManager.Task::(prepare) Task=`09a1e0e7-9ab9-4a84-bc59-f31392db0618`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721138::DEBUG::2014-06-26 17:07:37,470::task::595::Storage.TaskManager.Task::(_updateState) Task=`09a1e0e7-9ab9-4a84-bc59-f31392db0618`::moving from state preparing -> state finished >Thread-721138::DEBUG::2014-06-26 17:07:37,470::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721138::DEBUG::2014-06-26 17:07:37,470::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721138::DEBUG::2014-06-26 17:07:37,470::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721138::DEBUG::2014-06-26 17:07:37,470::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721138::DEBUG::2014-06-26 17:07:37,470::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721138::DEBUG::2014-06-26 17:07:37,470::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721138::DEBUG::2014-06-26 17:07:37,470::task::993::Storage.TaskManager.Task::(_decref) Task=`09a1e0e7-9ab9-4a84-bc59-f31392db0618`::ref 0 aborting False >Thread-721138::DEBUG::2014-06-26 17:07:37,471::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:38,248::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:38,248::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:38,248::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:38,248::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:38,248::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:38,249::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:38,249::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721139::DEBUG::2014-06-26 17:07:38,249::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721139::DEBUG::2014-06-26 17:07:38,250::task::595::Storage.TaskManager.Task::(_updateState) Task=`4af525cc-0502-4065-847f-afaf41205a3c`::moving from state init -> state preparing >Thread-721139::INFO::2014-06-26 17:07:38,250::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721139::INFO::2014-06-26 17:07:38,251::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000496682', 'lastCheck': '0.8', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000314804', 'lastCheck': '3.7', 'valid': True}} >Thread-721139::DEBUG::2014-06-26 17:07:38,251::task::1191::Storage.TaskManager.Task::(prepare) Task=`4af525cc-0502-4065-847f-afaf41205a3c`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000496682', 'lastCheck': '0.8', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000314804', 'lastCheck': '3.7', 'valid': True}} >Thread-721139::DEBUG::2014-06-26 17:07:38,251::task::595::Storage.TaskManager.Task::(_updateState) Task=`4af525cc-0502-4065-847f-afaf41205a3c`::moving from state preparing -> state finished >Thread-721139::DEBUG::2014-06-26 17:07:38,251::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721139::DEBUG::2014-06-26 17:07:38,251::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721139::DEBUG::2014-06-26 17:07:38,251::task::993::Storage.TaskManager.Task::(_decref) Task=`4af525cc-0502-4065-847f-afaf41205a3c`::ref 0 aborting False >Thread-721139::DEBUG::2014-06-26 17:07:38,253::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:38,311::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:38,311::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:38,311::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:38,311::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:38,311::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:38,312::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:38,312::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721140::DEBUG::2014-06-26 17:07:38,312::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721140::DEBUG::2014-06-26 17:07:38,313::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:38,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:38,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118263 s, 86.6 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:07:40,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:40,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115404 s, 88.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:41,356::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:41,356::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:41,356::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:41,356::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:41,356::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:41,357::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:41,357::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721141::DEBUG::2014-06-26 17:07:41,357::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721141::DEBUG::2014-06-26 17:07:41,358::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:42,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:42,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117877 s, 86.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:44,371::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:44,371::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:44,371::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:44,371::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:44,371::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:44,372::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:44,372::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721142::DEBUG::2014-06-26 17:07:44,372::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721142::DEBUG::2014-06-26 17:07:44,373::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:07:44,580::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:07:44,587::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000287617 s, 1.9 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:07:44,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:44,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120152 s, 85.2 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:07:46,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:46,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118972 s, 86.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:47,383::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:47,384::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:47,384::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:47,384::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:47,384::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:47,385::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:47,385::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721143::DEBUG::2014-06-26 17:07:47,385::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721143::DEBUG::2014-06-26 17:07:47,386::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:07:47,420::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:07:47,428::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000523741 s, 750 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:47,499::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:47,499::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:47,499::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:47,499::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:47,499::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:47,500::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:47,500::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721144::DEBUG::2014-06-26 17:07:47,500::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721144::DEBUG::2014-06-26 17:07:47,501::task::595::Storage.TaskManager.Task::(_updateState) Task=`7dea9a41-ed00-4223-88d9-f5b08ad8bc95`::moving from state init -> state preparing >Thread-721144::INFO::2014-06-26 17:07:47,501::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721144::INFO::2014-06-26 17:07:47,502::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721144::DEBUG::2014-06-26 17:07:47,502::task::1191::Storage.TaskManager.Task::(prepare) Task=`7dea9a41-ed00-4223-88d9-f5b08ad8bc95`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721144::DEBUG::2014-06-26 17:07:47,502::task::595::Storage.TaskManager.Task::(_updateState) Task=`7dea9a41-ed00-4223-88d9-f5b08ad8bc95`::moving from state preparing -> state finished >Thread-721144::DEBUG::2014-06-26 17:07:47,502::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721144::DEBUG::2014-06-26 17:07:47,502::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721144::DEBUG::2014-06-26 17:07:47,502::task::993::Storage.TaskManager.Task::(_decref) Task=`7dea9a41-ed00-4223-88d9-f5b08ad8bc95`::ref 0 aborting False >Thread-721144::DEBUG::2014-06-26 17:07:47,502::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:47,516::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:47,516::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:47,516::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:47,516::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:47,516::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:47,516::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:47,517::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721145::DEBUG::2014-06-26 17:07:47,517::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721145::DEBUG::2014-06-26 17:07:47,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd1423e3-0d00-4c2e-9f97-ce3d34d1c54f`::moving from state init -> state preparing >Thread-721145::INFO::2014-06-26 17:07:47,518::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721145::DEBUG::2014-06-26 17:07:47,518::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`ee47e281-265f-4039-95d4-ccaa9255e579`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721145::DEBUG::2014-06-26 17:07:47,518::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721145::DEBUG::2014-06-26 17:07:47,518::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721145::DEBUG::2014-06-26 17:07:47,518::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`ee47e281-265f-4039-95d4-ccaa9255e579`::Granted request >Thread-721145::DEBUG::2014-06-26 17:07:47,519::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`dd1423e3-0d00-4c2e-9f97-ce3d34d1c54f`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721145::DEBUG::2014-06-26 17:07:47,519::task::993::Storage.TaskManager.Task::(_decref) Task=`dd1423e3-0d00-4c2e-9f97-ce3d34d1c54f`::ref 1 aborting False >Thread-721145::INFO::2014-06-26 17:07:47,521::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721145::DEBUG::2014-06-26 17:07:47,521::task::1191::Storage.TaskManager.Task::(prepare) Task=`dd1423e3-0d00-4c2e-9f97-ce3d34d1c54f`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721145::DEBUG::2014-06-26 17:07:47,521::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd1423e3-0d00-4c2e-9f97-ce3d34d1c54f`::moving from state preparing -> state finished >Thread-721145::DEBUG::2014-06-26 17:07:47,521::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721145::DEBUG::2014-06-26 17:07:47,521::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721145::DEBUG::2014-06-26 17:07:47,521::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721145::DEBUG::2014-06-26 17:07:47,522::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721145::DEBUG::2014-06-26 17:07:47,522::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721145::DEBUG::2014-06-26 17:07:47,522::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721145::DEBUG::2014-06-26 17:07:47,522::task::993::Storage.TaskManager.Task::(_decref) Task=`dd1423e3-0d00-4c2e-9f97-ce3d34d1c54f`::ref 0 aborting False >Thread-721145::DEBUG::2014-06-26 17:07:47,522::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:48,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:48,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117829 s, 86.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:50,481::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:50,481::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:50,481::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:50,482::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:50,482::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:50,482::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721146::DEBUG::2014-06-26 17:07:50,483::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:07:50,483::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721146::DEBUG::2014-06-26 17:07:50,484::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:50,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:50,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116961 s, 87.6 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:07:53,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:53,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116724 s, 87.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:53,502::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:53,502::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:53,502::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:53,502::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:53,503::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:53,503::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:53,504::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721147::DEBUG::2014-06-26 17:07:53,504::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721147::DEBUG::2014-06-26 17:07:53,505::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e2559db-25a2-42aa-b423-4f489d3e0a83`::moving from state init -> state preparing >Thread-721147::INFO::2014-06-26 17:07:53,505::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721147::INFO::2014-06-26 17:07:53,505::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523741', 'lastCheck': '6.1', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000287617', 'lastCheck': '8.9', 'valid': True}} >Thread-721147::DEBUG::2014-06-26 17:07:53,505::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e2559db-25a2-42aa-b423-4f489d3e0a83`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523741', 'lastCheck': '6.1', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000287617', 'lastCheck': '8.9', 'valid': True}} >Thread-721147::DEBUG::2014-06-26 17:07:53,506::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e2559db-25a2-42aa-b423-4f489d3e0a83`::moving from state preparing -> state finished >Thread-721147::DEBUG::2014-06-26 17:07:53,506::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721147::DEBUG::2014-06-26 17:07:53,506::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721147::DEBUG::2014-06-26 17:07:53,506::task::993::Storage.TaskManager.Task::(_decref) Task=`0e2559db-25a2-42aa-b423-4f489d3e0a83`::ref 0 aborting False >Thread-721147::DEBUG::2014-06-26 17:07:53,508::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:53,571::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:53,572::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:53,572::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:53,572::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:53,572::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:53,572::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:53,573::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721148::DEBUG::2014-06-26 17:07:53,573::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721148::DEBUG::2014-06-26 17:07:53,574::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:07:54,589::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:07:54,596::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.00025984 s, 2.2 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:07:55,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:55,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118713 s, 86.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:56,630::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:56,630::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:56,630::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:56,630::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:56,630::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:56,631::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:56,631::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721149::DEBUG::2014-06-26 17:07:56,631::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721149::DEBUG::2014-06-26 17:07:56,632::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:57,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:57,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120875 s, 84.7 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:07:57,433::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:07:57,441::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000572307 s, 687 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:57,551::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:57,551::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:57,552::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:57,552::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:57,552::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:57,552::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:57,553::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721150::DEBUG::2014-06-26 17:07:57,553::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721150::DEBUG::2014-06-26 17:07:57,554::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac2f85a2-a869-429f-9e78-148306ff0ae8`::moving from state init -> state preparing >Thread-721150::INFO::2014-06-26 17:07:57,554::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721150::INFO::2014-06-26 17:07:57,554::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721150::DEBUG::2014-06-26 17:07:57,554::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac2f85a2-a869-429f-9e78-148306ff0ae8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721150::DEBUG::2014-06-26 17:07:57,554::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac2f85a2-a869-429f-9e78-148306ff0ae8`::moving from state preparing -> state finished >Thread-721150::DEBUG::2014-06-26 17:07:57,554::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721150::DEBUG::2014-06-26 17:07:57,554::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721150::DEBUG::2014-06-26 17:07:57,554::task::993::Storage.TaskManager.Task::(_decref) Task=`ac2f85a2-a869-429f-9e78-148306ff0ae8`::ref 0 aborting False >Thread-721150::DEBUG::2014-06-26 17:07:57,555::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:57,569::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:57,569::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:57,569::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:57,569::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:57,569::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:57,569::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:57,570::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721151::DEBUG::2014-06-26 17:07:57,570::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721151::DEBUG::2014-06-26 17:07:57,570::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c96f833-9bb8-42b9-8a3e-35c4115207ad`::moving from state init -> state preparing >Thread-721151::INFO::2014-06-26 17:07:57,570::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721151::DEBUG::2014-06-26 17:07:57,571::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`13495d9b-d2f6-4a7a-93e8-0ab48188ea30`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721151::DEBUG::2014-06-26 17:07:57,571::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721151::DEBUG::2014-06-26 17:07:57,571::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721151::DEBUG::2014-06-26 17:07:57,571::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`13495d9b-d2f6-4a7a-93e8-0ab48188ea30`::Granted request >Thread-721151::DEBUG::2014-06-26 17:07:57,571::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1c96f833-9bb8-42b9-8a3e-35c4115207ad`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721151::DEBUG::2014-06-26 17:07:57,571::task::993::Storage.TaskManager.Task::(_decref) Task=`1c96f833-9bb8-42b9-8a3e-35c4115207ad`::ref 1 aborting False >Thread-721151::INFO::2014-06-26 17:07:57,574::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721151::DEBUG::2014-06-26 17:07:57,574::task::1191::Storage.TaskManager.Task::(prepare) Task=`1c96f833-9bb8-42b9-8a3e-35c4115207ad`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721151::DEBUG::2014-06-26 17:07:57,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c96f833-9bb8-42b9-8a3e-35c4115207ad`::moving from state preparing -> state finished >Thread-721151::DEBUG::2014-06-26 17:07:57,574::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721151::DEBUG::2014-06-26 17:07:57,574::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721151::DEBUG::2014-06-26 17:07:57,574::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721151::DEBUG::2014-06-26 17:07:57,574::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721151::DEBUG::2014-06-26 17:07:57,574::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721151::DEBUG::2014-06-26 17:07:57,574::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721151::DEBUG::2014-06-26 17:07:57,575::task::993::Storage.TaskManager.Task::(_decref) Task=`1c96f833-9bb8-42b9-8a3e-35c4115207ad`::ref 0 aborting False >Thread-721151::DEBUG::2014-06-26 17:07:57,575::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:07:59,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:07:59,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117178 s, 87.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:59,644::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:59,644::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:59,644::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:07:59,644::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:07:59,644::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:07:59,645::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:07:59,645::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721152::DEBUG::2014-06-26 17:07:59,645::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721152::DEBUG::2014-06-26 17:07:59,646::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:01,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:01,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115264 s, 88.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:02,660::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:02,660::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:02,660::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:02,660::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:02,661::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:02,661::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721153::DEBUG::2014-06-26 17:08:02,662::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:08:02,662::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721153::DEBUG::2014-06-26 17:08:02,663::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:03,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:03,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117186 s, 87.4 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:08:04,598::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:08:04,605::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000246698 s, 2.3 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:08:05,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:05,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121482 s, 84.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:05,674::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:05,674::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:05,674::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:05,674::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:05,674::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:05,675::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:05,675::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721154::DEBUG::2014-06-26 17:08:05,675::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721154::DEBUG::2014-06-26 17:08:05,676::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:07,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:07,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119549 s, 85.7 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:08:07,443::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:08:07,450::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000527454 s, 745 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:07,606::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:07,606::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:07,606::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:07,607::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:07,607::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:07,607::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721155::DEBUG::2014-06-26 17:08:07,608::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:08:07,608::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721155::DEBUG::2014-06-26 17:08:07,609::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8e98210-0612-47a4-ba68-9fbb3c9bb4bb`::moving from state init -> state preparing >Thread-721155::INFO::2014-06-26 17:08:07,609::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721155::INFO::2014-06-26 17:08:07,609::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721155::DEBUG::2014-06-26 17:08:07,609::task::1191::Storage.TaskManager.Task::(prepare) Task=`f8e98210-0612-47a4-ba68-9fbb3c9bb4bb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721155::DEBUG::2014-06-26 17:08:07,609::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8e98210-0612-47a4-ba68-9fbb3c9bb4bb`::moving from state preparing -> state finished >Thread-721155::DEBUG::2014-06-26 17:08:07,609::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721155::DEBUG::2014-06-26 17:08:07,610::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721155::DEBUG::2014-06-26 17:08:07,610::task::993::Storage.TaskManager.Task::(_decref) Task=`f8e98210-0612-47a4-ba68-9fbb3c9bb4bb`::ref 0 aborting False >Thread-721155::DEBUG::2014-06-26 17:08:07,610::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:07,632::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:07,632::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:07,632::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:07,632::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:07,633::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:07,633::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721156::DEBUG::2014-06-26 17:08:07,633::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:08:07,633::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721156::DEBUG::2014-06-26 17:08:07,634::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6781680-0659-4079-8a68-2895967af9ae`::moving from state init -> state preparing >Thread-721156::INFO::2014-06-26 17:08:07,634::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721156::DEBUG::2014-06-26 17:08:07,634::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`ab1f5fad-3d0a-4225-aa6c-84bad222cc1e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721156::DEBUG::2014-06-26 17:08:07,634::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721156::DEBUG::2014-06-26 17:08:07,635::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721156::DEBUG::2014-06-26 17:08:07,635::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`ab1f5fad-3d0a-4225-aa6c-84bad222cc1e`::Granted request >Thread-721156::DEBUG::2014-06-26 17:08:07,635::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a6781680-0659-4079-8a68-2895967af9ae`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721156::DEBUG::2014-06-26 17:08:07,635::task::993::Storage.TaskManager.Task::(_decref) Task=`a6781680-0659-4079-8a68-2895967af9ae`::ref 1 aborting False >Thread-721156::INFO::2014-06-26 17:08:07,637::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721156::DEBUG::2014-06-26 17:08:07,637::task::1191::Storage.TaskManager.Task::(prepare) Task=`a6781680-0659-4079-8a68-2895967af9ae`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721156::DEBUG::2014-06-26 17:08:07,637::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6781680-0659-4079-8a68-2895967af9ae`::moving from state preparing -> state finished >Thread-721156::DEBUG::2014-06-26 17:08:07,637::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721156::DEBUG::2014-06-26 17:08:07,638::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721156::DEBUG::2014-06-26 17:08:07,638::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721156::DEBUG::2014-06-26 17:08:07,638::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721156::DEBUG::2014-06-26 17:08:07,638::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721156::DEBUG::2014-06-26 17:08:07,638::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721156::DEBUG::2014-06-26 17:08:07,638::task::993::Storage.TaskManager.Task::(_decref) Task=`a6781680-0659-4079-8a68-2895967af9ae`::ref 0 aborting False >Thread-721156::DEBUG::2014-06-26 17:08:07,638::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:08,686::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:08,686::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:08,686::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:08,686::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:08,687::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:08,687::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:08,687::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721157::DEBUG::2014-06-26 17:08:08,687::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721157::DEBUG::2014-06-26 17:08:08,688::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0db4522-55b5-4eff-9044-8b7b0d6c941d`::moving from state init -> state preparing >Thread-721157::INFO::2014-06-26 17:08:08,689::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721157::INFO::2014-06-26 17:08:08,689::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000527454', 'lastCheck': '1.2', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246698', 'lastCheck': '4.1', 'valid': True}} >Thread-721157::DEBUG::2014-06-26 17:08:08,689::task::1191::Storage.TaskManager.Task::(prepare) Task=`d0db4522-55b5-4eff-9044-8b7b0d6c941d`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000527454', 'lastCheck': '1.2', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246698', 'lastCheck': '4.1', 'valid': True}} >Thread-721157::DEBUG::2014-06-26 17:08:08,689::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0db4522-55b5-4eff-9044-8b7b0d6c941d`::moving from state preparing -> state finished >Thread-721157::DEBUG::2014-06-26 17:08:08,689::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721157::DEBUG::2014-06-26 17:08:08,689::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721157::DEBUG::2014-06-26 17:08:08,689::task::993::Storage.TaskManager.Task::(_decref) Task=`d0db4522-55b5-4eff-9044-8b7b0d6c941d`::ref 0 aborting False >Thread-721157::DEBUG::2014-06-26 17:08:08,691::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:08,721::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:08,722::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:08,722::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:08,722::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:08,722::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:08,722::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721158::DEBUG::2014-06-26 17:08:08,722::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:08:08,722::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721158::DEBUG::2014-06-26 17:08:08,723::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:09,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:09,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120553 s, 84.9 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:08:11,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:11,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119513 s, 85.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:11,756::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:11,756::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:11,756::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:11,756::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:11,757::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:11,757::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:11,758::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721159::DEBUG::2014-06-26 17:08:11,758::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721159::DEBUG::2014-06-26 17:08:11,759::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:13,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:13,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115751 s, 88.5 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:08:14,607::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:08:14,614::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000257862 s, 2.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:14,769::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:14,769::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:14,769::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:14,769::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:14,770::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:14,770::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:14,770::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721160::DEBUG::2014-06-26 17:08:14,770::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721160::DEBUG::2014-06-26 17:08:14,771::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:15,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:15,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118912 s, 86.1 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:08:17,453::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:08:17,460::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000497293 s, 790 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:08:17,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:17,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118408 s, 86.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:17,675::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:17,675::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:17,676::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:17,676::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:17,677::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:17,677::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721161::DEBUG::2014-06-26 17:08:17,679::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:08:17,679::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721161::DEBUG::2014-06-26 17:08:17,682::task::595::Storage.TaskManager.Task::(_updateState) Task=`ccdbb0d5-1735-43ff-a56b-324ce951ea86`::moving from state init -> state preparing >Thread-721161::INFO::2014-06-26 17:08:17,682::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721161::INFO::2014-06-26 17:08:17,683::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721161::DEBUG::2014-06-26 17:08:17,683::task::1191::Storage.TaskManager.Task::(prepare) Task=`ccdbb0d5-1735-43ff-a56b-324ce951ea86`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721161::DEBUG::2014-06-26 17:08:17,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`ccdbb0d5-1735-43ff-a56b-324ce951ea86`::moving from state preparing -> state finished >Thread-721161::DEBUG::2014-06-26 17:08:17,683::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721161::DEBUG::2014-06-26 17:08:17,683::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721161::DEBUG::2014-06-26 17:08:17,683::task::993::Storage.TaskManager.Task::(_decref) Task=`ccdbb0d5-1735-43ff-a56b-324ce951ea86`::ref 0 aborting False >Thread-721161::DEBUG::2014-06-26 17:08:17,683::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:17,697::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:17,698::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:17,698::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:17,698::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:17,698::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:17,698::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:17,698::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721162::DEBUG::2014-06-26 17:08:17,699::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721162::DEBUG::2014-06-26 17:08:17,699::task::595::Storage.TaskManager.Task::(_updateState) Task=`d417fec6-f745-4a4f-a257-4f75ca5a62f0`::moving from state init -> state preparing >Thread-721162::INFO::2014-06-26 17:08:17,699::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721162::DEBUG::2014-06-26 17:08:17,700::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`5200e327-05aa-4f40-afaf-99f436982750`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721162::DEBUG::2014-06-26 17:08:17,700::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721162::DEBUG::2014-06-26 17:08:17,700::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721162::DEBUG::2014-06-26 17:08:17,700::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`5200e327-05aa-4f40-afaf-99f436982750`::Granted request >Thread-721162::DEBUG::2014-06-26 17:08:17,700::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d417fec6-f745-4a4f-a257-4f75ca5a62f0`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721162::DEBUG::2014-06-26 17:08:17,700::task::993::Storage.TaskManager.Task::(_decref) Task=`d417fec6-f745-4a4f-a257-4f75ca5a62f0`::ref 1 aborting False >Thread-721162::INFO::2014-06-26 17:08:17,702::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721162::DEBUG::2014-06-26 17:08:17,703::task::1191::Storage.TaskManager.Task::(prepare) Task=`d417fec6-f745-4a4f-a257-4f75ca5a62f0`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721162::DEBUG::2014-06-26 17:08:17,703::task::595::Storage.TaskManager.Task::(_updateState) Task=`d417fec6-f745-4a4f-a257-4f75ca5a62f0`::moving from state preparing -> state finished >Thread-721162::DEBUG::2014-06-26 17:08:17,703::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721162::DEBUG::2014-06-26 17:08:17,703::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721162::DEBUG::2014-06-26 17:08:17,703::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721162::DEBUG::2014-06-26 17:08:17,703::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721162::DEBUG::2014-06-26 17:08:17,703::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721162::DEBUG::2014-06-26 17:08:17,703::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721162::DEBUG::2014-06-26 17:08:17,703::task::993::Storage.TaskManager.Task::(_decref) Task=`d417fec6-f745-4a4f-a257-4f75ca5a62f0`::ref 0 aborting False >Thread-721162::DEBUG::2014-06-26 17:08:17,704::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:17,782::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:17,783::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:17,783::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:17,783::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:17,783::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:17,783::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:17,784::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721163::DEBUG::2014-06-26 17:08:17,784::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721163::DEBUG::2014-06-26 17:08:17,784::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:19,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:19,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118537 s, 86.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:20,795::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:20,795::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:20,795::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:20,795::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:20,796::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:20,796::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:20,797::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721164::DEBUG::2014-06-26 17:08:20,797::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721164::DEBUG::2014-06-26 17:08:20,798::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:21,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:21,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117064 s, 87.5 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:08:23,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:23,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117417 s, 87.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:23,828::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:23,829::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:23,830::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:23,830::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:23,831::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:23,831::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721165::DEBUG::2014-06-26 17:08:23,833::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:08:23,833::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721165::DEBUG::2014-06-26 17:08:23,838::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a59f2a7-7c51-4921-b40e-f29a5e2ba817`::moving from state init -> state preparing >Thread-721165::INFO::2014-06-26 17:08:23,839::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721165::INFO::2014-06-26 17:08:23,839::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000497293', 'lastCheck': '6.4', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000257862', 'lastCheck': '9.2', 'valid': True}} >Thread-721165::DEBUG::2014-06-26 17:08:23,840::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a59f2a7-7c51-4921-b40e-f29a5e2ba817`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000497293', 'lastCheck': '6.4', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000257862', 'lastCheck': '9.2', 'valid': True}} >Thread-721165::DEBUG::2014-06-26 17:08:23,840::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a59f2a7-7c51-4921-b40e-f29a5e2ba817`::moving from state preparing -> state finished >Thread-721165::DEBUG::2014-06-26 17:08:23,841::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721165::DEBUG::2014-06-26 17:08:23,841::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721165::DEBUG::2014-06-26 17:08:23,841::task::993::Storage.TaskManager.Task::(_decref) Task=`0a59f2a7-7c51-4921-b40e-f29a5e2ba817`::ref 0 aborting False >Thread-721165::DEBUG::2014-06-26 17:08:23,853::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:23,888::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:23,888::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:23,888::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:23,888::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:23,888::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:23,889::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:23,889::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721166::DEBUG::2014-06-26 17:08:23,889::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721166::DEBUG::2014-06-26 17:08:23,890::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:08:24,617::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:08:24,623::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000236757 s, 2.4 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:08:25,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:25,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118956 s, 86.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:26,925::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:26,926::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:26,926::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:26,926::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:26,926::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:26,926::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:26,927::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721167::DEBUG::2014-06-26 17:08:26,927::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721167::DEBUG::2014-06-26 17:08:26,928::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:08:27,463::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:08:27,470::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.00048175 s, 816 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:27,729::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:27,729::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:27,729::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:27,729::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:27,730::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:27,730::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721168::DEBUG::2014-06-26 17:08:27,731::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:08:27,731::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721168::DEBUG::2014-06-26 17:08:27,732::task::595::Storage.TaskManager.Task::(_updateState) Task=`3847292e-3797-473f-bb58-89c2f7ba7eb6`::moving from state init -> state preparing >Thread-721168::INFO::2014-06-26 17:08:27,732::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721168::INFO::2014-06-26 17:08:27,733::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721168::DEBUG::2014-06-26 17:08:27,733::task::1191::Storage.TaskManager.Task::(prepare) Task=`3847292e-3797-473f-bb58-89c2f7ba7eb6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721168::DEBUG::2014-06-26 17:08:27,733::task::595::Storage.TaskManager.Task::(_updateState) Task=`3847292e-3797-473f-bb58-89c2f7ba7eb6`::moving from state preparing -> state finished >Thread-721168::DEBUG::2014-06-26 17:08:27,733::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721168::DEBUG::2014-06-26 17:08:27,733::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721168::DEBUG::2014-06-26 17:08:27,733::task::993::Storage.TaskManager.Task::(_decref) Task=`3847292e-3797-473f-bb58-89c2f7ba7eb6`::ref 0 aborting False >Thread-721168::DEBUG::2014-06-26 17:08:27,733::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:27,747::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:27,747::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:27,747::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:27,747::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:27,747::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:27,747::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:27,748::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721169::DEBUG::2014-06-26 17:08:27,748::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721169::DEBUG::2014-06-26 17:08:27,749::task::595::Storage.TaskManager.Task::(_updateState) Task=`eef203db-eea2-4740-9ca0-7f0578a51f41`::moving from state init -> state preparing >Thread-721169::INFO::2014-06-26 17:08:27,749::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721169::DEBUG::2014-06-26 17:08:27,749::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`048dde00-5e1e-4791-ae9f-d0b5156dd50d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721169::DEBUG::2014-06-26 17:08:27,749::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721169::DEBUG::2014-06-26 17:08:27,749::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721169::DEBUG::2014-06-26 17:08:27,749::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`048dde00-5e1e-4791-ae9f-d0b5156dd50d`::Granted request >Thread-721169::DEBUG::2014-06-26 17:08:27,750::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`eef203db-eea2-4740-9ca0-7f0578a51f41`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721169::DEBUG::2014-06-26 17:08:27,750::task::993::Storage.TaskManager.Task::(_decref) Task=`eef203db-eea2-4740-9ca0-7f0578a51f41`::ref 1 aborting False >Thread-721169::INFO::2014-06-26 17:08:27,752::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721169::DEBUG::2014-06-26 17:08:27,752::task::1191::Storage.TaskManager.Task::(prepare) Task=`eef203db-eea2-4740-9ca0-7f0578a51f41`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721169::DEBUG::2014-06-26 17:08:27,752::task::595::Storage.TaskManager.Task::(_updateState) Task=`eef203db-eea2-4740-9ca0-7f0578a51f41`::moving from state preparing -> state finished >Thread-721169::DEBUG::2014-06-26 17:08:27,752::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721169::DEBUG::2014-06-26 17:08:27,752::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721169::DEBUG::2014-06-26 17:08:27,753::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721169::DEBUG::2014-06-26 17:08:27,753::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721169::DEBUG::2014-06-26 17:08:27,753::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721169::DEBUG::2014-06-26 17:08:27,753::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721169::DEBUG::2014-06-26 17:08:27,753::task::993::Storage.TaskManager.Task::(_decref) Task=`eef203db-eea2-4740-9ca0-7f0578a51f41`::ref 0 aborting False >Thread-721169::DEBUG::2014-06-26 17:08:27,753::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:27,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:27,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117924 s, 86.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:29,941::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:29,941::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:29,941::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:29,941::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:29,942::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:29,942::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:29,942::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721170::DEBUG::2014-06-26 17:08:29,942::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721170::DEBUG::2014-06-26 17:08:29,943::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:29,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:30,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116345 s, 88.0 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:08:32,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:32,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118333 s, 86.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:32,956::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:32,956::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:32,956::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:32,956::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:32,956::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:32,957::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:32,957::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721171::DEBUG::2014-06-26 17:08:32,957::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721171::DEBUG::2014-06-26 17:08:32,958::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:34,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:34,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118758 s, 86.2 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:08:34,629::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:08:34,636::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.00022221 s, 2.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:35,970::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:35,970::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:35,970::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:35,970::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:35,970::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:35,971::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:35,971::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721172::DEBUG::2014-06-26 17:08:35,971::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721172::DEBUG::2014-06-26 17:08:35,972::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:36,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:36,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118888 s, 86.1 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:08:37,473::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:08:37,480::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000523726 s, 750 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:37,776::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:37,776::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:37,776::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:37,777::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:37,777::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:37,777::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:37,778::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721173::DEBUG::2014-06-26 17:08:37,778::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721173::DEBUG::2014-06-26 17:08:37,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`302a6236-6dfa-4429-be8f-9d02dc44b371`::moving from state init -> state preparing >Thread-721173::INFO::2014-06-26 17:08:37,779::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721173::INFO::2014-06-26 17:08:37,779::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721173::DEBUG::2014-06-26 17:08:37,779::task::1191::Storage.TaskManager.Task::(prepare) Task=`302a6236-6dfa-4429-be8f-9d02dc44b371`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721173::DEBUG::2014-06-26 17:08:37,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`302a6236-6dfa-4429-be8f-9d02dc44b371`::moving from state preparing -> state finished >Thread-721173::DEBUG::2014-06-26 17:08:37,779::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721173::DEBUG::2014-06-26 17:08:37,779::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721173::DEBUG::2014-06-26 17:08:37,779::task::993::Storage.TaskManager.Task::(_decref) Task=`302a6236-6dfa-4429-be8f-9d02dc44b371`::ref 0 aborting False >Thread-721173::DEBUG::2014-06-26 17:08:37,780::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:37,791::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:37,791::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:37,792::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:37,792::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:37,792::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:37,792::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:37,793::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721174::DEBUG::2014-06-26 17:08:37,793::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721174::DEBUG::2014-06-26 17:08:37,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7436c13-7494-4517-9d51-d234a62a3811`::moving from state init -> state preparing >Thread-721174::INFO::2014-06-26 17:08:37,793::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721174::DEBUG::2014-06-26 17:08:37,794::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`09ff54a0-dc6b-456e-8521-dc492dc9e8d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721174::DEBUG::2014-06-26 17:08:37,794::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721174::DEBUG::2014-06-26 17:08:37,794::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721174::DEBUG::2014-06-26 17:08:37,794::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`09ff54a0-dc6b-456e-8521-dc492dc9e8d9`::Granted request >Thread-721174::DEBUG::2014-06-26 17:08:37,794::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e7436c13-7494-4517-9d51-d234a62a3811`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721174::DEBUG::2014-06-26 17:08:37,794::task::993::Storage.TaskManager.Task::(_decref) Task=`e7436c13-7494-4517-9d51-d234a62a3811`::ref 1 aborting False >Thread-721174::INFO::2014-06-26 17:08:37,796::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721174::DEBUG::2014-06-26 17:08:37,797::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7436c13-7494-4517-9d51-d234a62a3811`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721174::DEBUG::2014-06-26 17:08:37,797::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7436c13-7494-4517-9d51-d234a62a3811`::moving from state preparing -> state finished >Thread-721174::DEBUG::2014-06-26 17:08:37,797::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721174::DEBUG::2014-06-26 17:08:37,797::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721174::DEBUG::2014-06-26 17:08:37,797::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721174::DEBUG::2014-06-26 17:08:37,797::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721174::DEBUG::2014-06-26 17:08:37,797::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721174::DEBUG::2014-06-26 17:08:37,797::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721174::DEBUG::2014-06-26 17:08:37,797::task::993::Storage.TaskManager.Task::(_decref) Task=`e7436c13-7494-4517-9d51-d234a62a3811`::ref 0 aborting False >Thread-721174::DEBUG::2014-06-26 17:08:37,798::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:38,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:38,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119928 s, 85.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:38,983::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:38,983::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:38,983::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:38,983::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:38,984::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:38,984::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:38,985::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721175::DEBUG::2014-06-26 17:08:38,985::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721175::DEBUG::2014-06-26 17:08:38,986::task::595::Storage.TaskManager.Task::(_updateState) Task=`900f7975-329d-44be-833a-112f4bc653e8`::moving from state init -> state preparing >Thread-721175::INFO::2014-06-26 17:08:38,986::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721175::INFO::2014-06-26 17:08:38,986::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523726', 'lastCheck': '1.5', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00022221', 'lastCheck': '4.3', 'valid': True}} >Thread-721175::DEBUG::2014-06-26 17:08:38,986::task::1191::Storage.TaskManager.Task::(prepare) Task=`900f7975-329d-44be-833a-112f4bc653e8`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523726', 'lastCheck': '1.5', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00022221', 'lastCheck': '4.3', 'valid': True}} >Thread-721175::DEBUG::2014-06-26 17:08:38,986::task::595::Storage.TaskManager.Task::(_updateState) Task=`900f7975-329d-44be-833a-112f4bc653e8`::moving from state preparing -> state finished >Thread-721175::DEBUG::2014-06-26 17:08:38,987::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721175::DEBUG::2014-06-26 17:08:38,987::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721175::DEBUG::2014-06-26 17:08:38,987::task::993::Storage.TaskManager.Task::(_decref) Task=`900f7975-329d-44be-833a-112f4bc653e8`::ref 0 aborting False >Thread-721175::DEBUG::2014-06-26 17:08:38,989::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:39,028::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:39,028::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:39,028::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:39,029::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:39,029::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:39,029::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:39,029::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721176::DEBUG::2014-06-26 17:08:39,029::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721176::DEBUG::2014-06-26 17:08:39,030::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:40,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:40,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116779 s, 87.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:42,071::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:42,072::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:42,072::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:42,072::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:42,072::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:42,072::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:42,073::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721177::DEBUG::2014-06-26 17:08:42,073::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721177::DEBUG::2014-06-26 17:08:42,074::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:42,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:42,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121524 s, 84.3 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:08:44,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:44,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012057 s, 84.9 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:08:44,638::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:08:44,645::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000240121 s, 2.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:45,083::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:45,083::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:45,083::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:45,083::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:45,084::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:45,084::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:45,085::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721178::DEBUG::2014-06-26 17:08:45,085::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721178::DEBUG::2014-06-26 17:08:45,086::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:46,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:46,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120243 s, 85.2 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:08:47,482::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:08:47,489::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000549216 s, 716 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:47,819::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:47,819::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:47,819::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:47,819::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:47,819::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:47,820::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:47,820::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721179::DEBUG::2014-06-26 17:08:47,820::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721179::DEBUG::2014-06-26 17:08:47,821::task::595::Storage.TaskManager.Task::(_updateState) Task=`12659374-d7e5-4f0b-869f-e3b0080568eb`::moving from state init -> state preparing >Thread-721179::INFO::2014-06-26 17:08:47,821::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721179::INFO::2014-06-26 17:08:47,821::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721179::DEBUG::2014-06-26 17:08:47,821::task::1191::Storage.TaskManager.Task::(prepare) Task=`12659374-d7e5-4f0b-869f-e3b0080568eb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721179::DEBUG::2014-06-26 17:08:47,822::task::595::Storage.TaskManager.Task::(_updateState) Task=`12659374-d7e5-4f0b-869f-e3b0080568eb`::moving from state preparing -> state finished >Thread-721179::DEBUG::2014-06-26 17:08:47,822::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721179::DEBUG::2014-06-26 17:08:47,822::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721179::DEBUG::2014-06-26 17:08:47,822::task::993::Storage.TaskManager.Task::(_decref) Task=`12659374-d7e5-4f0b-869f-e3b0080568eb`::ref 0 aborting False >Thread-721179::DEBUG::2014-06-26 17:08:47,822::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:47,836::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:47,836::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:47,836::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:47,837::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:47,837::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:47,837::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:47,837::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721180::DEBUG::2014-06-26 17:08:47,837::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721180::DEBUG::2014-06-26 17:08:47,838::task::595::Storage.TaskManager.Task::(_updateState) Task=`78315acc-0308-4ad7-8895-8e2016d8339a`::moving from state init -> state preparing >Thread-721180::INFO::2014-06-26 17:08:47,838::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721180::DEBUG::2014-06-26 17:08:47,838::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`ee5228c6-9ca1-41b7-9c17-10a0fe9ae2e5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721180::DEBUG::2014-06-26 17:08:47,838::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721180::DEBUG::2014-06-26 17:08:47,839::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721180::DEBUG::2014-06-26 17:08:47,839::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`ee5228c6-9ca1-41b7-9c17-10a0fe9ae2e5`::Granted request >Thread-721180::DEBUG::2014-06-26 17:08:47,839::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`78315acc-0308-4ad7-8895-8e2016d8339a`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721180::DEBUG::2014-06-26 17:08:47,839::task::993::Storage.TaskManager.Task::(_decref) Task=`78315acc-0308-4ad7-8895-8e2016d8339a`::ref 1 aborting False >Thread-721180::INFO::2014-06-26 17:08:47,841::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721180::DEBUG::2014-06-26 17:08:47,841::task::1191::Storage.TaskManager.Task::(prepare) Task=`78315acc-0308-4ad7-8895-8e2016d8339a`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721180::DEBUG::2014-06-26 17:08:47,841::task::595::Storage.TaskManager.Task::(_updateState) Task=`78315acc-0308-4ad7-8895-8e2016d8339a`::moving from state preparing -> state finished >Thread-721180::DEBUG::2014-06-26 17:08:47,842::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721180::DEBUG::2014-06-26 17:08:47,842::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721180::DEBUG::2014-06-26 17:08:47,842::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721180::DEBUG::2014-06-26 17:08:47,842::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721180::DEBUG::2014-06-26 17:08:47,842::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721180::DEBUG::2014-06-26 17:08:47,842::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721180::DEBUG::2014-06-26 17:08:47,842::task::993::Storage.TaskManager.Task::(_decref) Task=`78315acc-0308-4ad7-8895-8e2016d8339a`::ref 0 aborting False >Thread-721180::DEBUG::2014-06-26 17:08:47,843::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:48,095::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:48,095::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:48,095::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:48,095::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:48,095::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:48,096::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:48,096::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721181::DEBUG::2014-06-26 17:08:48,096::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721181::DEBUG::2014-06-26 17:08:48,097::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:48,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:48,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117321 s, 87.3 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:08:50,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:50,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120558 s, 84.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:51,108::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:51,108::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:51,108::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:51,108::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:51,109::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:51,109::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:51,109::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721182::DEBUG::2014-06-26 17:08:51,109::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721182::DEBUG::2014-06-26 17:08:51,110::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:52,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:52,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115855 s, 88.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:54,121::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:54,121::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:54,121::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:54,121::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:54,121::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:54,122::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:54,122::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721183::DEBUG::2014-06-26 17:08:54,122::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721183::DEBUG::2014-06-26 17:08:54,123::task::595::Storage.TaskManager.Task::(_updateState) Task=`4691e0c4-d161-4052-bf9b-b79ea684a4ed`::moving from state init -> state preparing >Thread-721183::INFO::2014-06-26 17:08:54,124::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721183::INFO::2014-06-26 17:08:54,124::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000549216', 'lastCheck': '6.6', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000240121', 'lastCheck': '9.5', 'valid': True}} >Thread-721183::DEBUG::2014-06-26 17:08:54,124::task::1191::Storage.TaskManager.Task::(prepare) Task=`4691e0c4-d161-4052-bf9b-b79ea684a4ed`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000549216', 'lastCheck': '6.6', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000240121', 'lastCheck': '9.5', 'valid': True}} >Thread-721183::DEBUG::2014-06-26 17:08:54,124::task::595::Storage.TaskManager.Task::(_updateState) Task=`4691e0c4-d161-4052-bf9b-b79ea684a4ed`::moving from state preparing -> state finished >Thread-721183::DEBUG::2014-06-26 17:08:54,124::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721183::DEBUG::2014-06-26 17:08:54,124::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721183::DEBUG::2014-06-26 17:08:54,124::task::993::Storage.TaskManager.Task::(_decref) Task=`4691e0c4-d161-4052-bf9b-b79ea684a4ed`::ref 0 aborting False >Thread-721183::DEBUG::2014-06-26 17:08:54,126::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:54,158::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:54,158::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:54,158::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:54,159::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:54,159::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:54,159::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:54,159::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721184::DEBUG::2014-06-26 17:08:54,159::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721184::DEBUG::2014-06-26 17:08:54,160::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:54,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:54,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117959 s, 86.8 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:08:54,647::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:08:54,654::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000247605 s, 2.3 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:08:56,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:56,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119151 s, 85.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:57,191::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:57,191::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:57,191::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:57,191::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:57,192::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:57,192::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:57,192::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721185::DEBUG::2014-06-26 17:08:57,193::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721185::DEBUG::2014-06-26 17:08:57,194::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:08:57,492::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:08:57,499::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000648128 s, 606 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:57,871::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:57,871::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:57,871::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:57,871::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:57,871::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:57,872::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:57,872::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721186::DEBUG::2014-06-26 17:08:57,872::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721186::DEBUG::2014-06-26 17:08:57,873::task::595::Storage.TaskManager.Task::(_updateState) Task=`55f45226-ce6e-4bc6-8210-0c5ad6a02e12`::moving from state init -> state preparing >Thread-721186::INFO::2014-06-26 17:08:57,873::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721186::INFO::2014-06-26 17:08:57,873::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721186::DEBUG::2014-06-26 17:08:57,873::task::1191::Storage.TaskManager.Task::(prepare) Task=`55f45226-ce6e-4bc6-8210-0c5ad6a02e12`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721186::DEBUG::2014-06-26 17:08:57,874::task::595::Storage.TaskManager.Task::(_updateState) Task=`55f45226-ce6e-4bc6-8210-0c5ad6a02e12`::moving from state preparing -> state finished >Thread-721186::DEBUG::2014-06-26 17:08:57,874::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721186::DEBUG::2014-06-26 17:08:57,874::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721186::DEBUG::2014-06-26 17:08:57,874::task::993::Storage.TaskManager.Task::(_decref) Task=`55f45226-ce6e-4bc6-8210-0c5ad6a02e12`::ref 0 aborting False >Thread-721186::DEBUG::2014-06-26 17:08:57,874::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:57,888::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:57,888::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:57,888::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:08:57,888::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:08:57,889::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:08:57,889::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:08:57,889::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721187::DEBUG::2014-06-26 17:08:57,889::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721187::DEBUG::2014-06-26 17:08:57,890::task::595::Storage.TaskManager.Task::(_updateState) Task=`d44a663c-ea95-4db8-9733-aa58e826e319`::moving from state init -> state preparing >Thread-721187::INFO::2014-06-26 17:08:57,890::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721187::DEBUG::2014-06-26 17:08:57,890::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`dd2617d5-65bc-45ed-8573-3f4846846919`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721187::DEBUG::2014-06-26 17:08:57,891::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721187::DEBUG::2014-06-26 17:08:57,891::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721187::DEBUG::2014-06-26 17:08:57,891::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`dd2617d5-65bc-45ed-8573-3f4846846919`::Granted request >Thread-721187::DEBUG::2014-06-26 17:08:57,892::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d44a663c-ea95-4db8-9733-aa58e826e319`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721187::DEBUG::2014-06-26 17:08:57,892::task::993::Storage.TaskManager.Task::(_decref) Task=`d44a663c-ea95-4db8-9733-aa58e826e319`::ref 1 aborting False >Thread-721187::INFO::2014-06-26 17:08:57,894::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721187::DEBUG::2014-06-26 17:08:57,894::task::1191::Storage.TaskManager.Task::(prepare) Task=`d44a663c-ea95-4db8-9733-aa58e826e319`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721187::DEBUG::2014-06-26 17:08:57,894::task::595::Storage.TaskManager.Task::(_updateState) Task=`d44a663c-ea95-4db8-9733-aa58e826e319`::moving from state preparing -> state finished >Thread-721187::DEBUG::2014-06-26 17:08:57,894::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721187::DEBUG::2014-06-26 17:08:57,894::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721187::DEBUG::2014-06-26 17:08:57,894::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721187::DEBUG::2014-06-26 17:08:57,895::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721187::DEBUG::2014-06-26 17:08:57,895::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721187::DEBUG::2014-06-26 17:08:57,895::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721187::DEBUG::2014-06-26 17:08:57,895::task::993::Storage.TaskManager.Task::(_decref) Task=`d44a663c-ea95-4db8-9733-aa58e826e319`::ref 0 aborting False >Thread-721187::DEBUG::2014-06-26 17:08:57,895::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:08:58,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:08:58,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117624 s, 87.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:00,204::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:00,205::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:00,205::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:00,205::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:00,205::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:00,205::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:00,206::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721188::DEBUG::2014-06-26 17:09:00,206::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721188::DEBUG::2014-06-26 17:09:00,207::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:00,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:00,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117192 s, 87.4 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:09:02,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:02,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121547 s, 84.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:03,218::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:03,218::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:03,218::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:03,218::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:03,219::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:03,219::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:03,219::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721189::DEBUG::2014-06-26 17:09:03,219::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721189::DEBUG::2014-06-26 17:09:03,220::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:09:04,656::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:09:04,663::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000275578 s, 2.0 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:09:04,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:04,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118989 s, 86.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:06,232::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:06,232::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:06,232::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:06,232::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:06,233::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:06,233::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:06,233::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721190::DEBUG::2014-06-26 17:09:06,234::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721190::DEBUG::2014-06-26 17:09:06,235::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:06,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:06,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173215 s, 59.1 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:09:07,501::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:09:07,509::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000499643 s, 787 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:07,929::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:07,929::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:07,929::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:07,929::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:07,930::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:07,930::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:07,931::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721191::DEBUG::2014-06-26 17:09:07,931::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721191::DEBUG::2014-06-26 17:09:07,932::task::595::Storage.TaskManager.Task::(_updateState) Task=`19f4de37-a882-4ab0-ae8c-c6c2e4201f28`::moving from state init -> state preparing >Thread-721191::INFO::2014-06-26 17:09:07,932::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721191::INFO::2014-06-26 17:09:07,932::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721191::DEBUG::2014-06-26 17:09:07,932::task::1191::Storage.TaskManager.Task::(prepare) Task=`19f4de37-a882-4ab0-ae8c-c6c2e4201f28`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721191::DEBUG::2014-06-26 17:09:07,932::task::595::Storage.TaskManager.Task::(_updateState) Task=`19f4de37-a882-4ab0-ae8c-c6c2e4201f28`::moving from state preparing -> state finished >Thread-721191::DEBUG::2014-06-26 17:09:07,932::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721191::DEBUG::2014-06-26 17:09:07,932::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721191::DEBUG::2014-06-26 17:09:07,932::task::993::Storage.TaskManager.Task::(_decref) Task=`19f4de37-a882-4ab0-ae8c-c6c2e4201f28`::ref 0 aborting False >Thread-721191::DEBUG::2014-06-26 17:09:07,933::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:07,954::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:07,954::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:07,954::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:07,954::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:07,955::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:07,955::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:07,955::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721192::DEBUG::2014-06-26 17:09:07,955::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721192::DEBUG::2014-06-26 17:09:07,956::task::595::Storage.TaskManager.Task::(_updateState) Task=`2585f857-f7ad-4be6-82d3-f3237d10d141`::moving from state init -> state preparing >Thread-721192::INFO::2014-06-26 17:09:07,956::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721192::DEBUG::2014-06-26 17:09:07,956::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`a2c47817-9ceb-45b0-8328-512d388edac1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721192::DEBUG::2014-06-26 17:09:07,956::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721192::DEBUG::2014-06-26 17:09:07,957::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721192::DEBUG::2014-06-26 17:09:07,957::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`a2c47817-9ceb-45b0-8328-512d388edac1`::Granted request >Thread-721192::DEBUG::2014-06-26 17:09:07,957::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2585f857-f7ad-4be6-82d3-f3237d10d141`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721192::DEBUG::2014-06-26 17:09:07,957::task::993::Storage.TaskManager.Task::(_decref) Task=`2585f857-f7ad-4be6-82d3-f3237d10d141`::ref 1 aborting False >Thread-721192::INFO::2014-06-26 17:09:07,959::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721192::DEBUG::2014-06-26 17:09:07,959::task::1191::Storage.TaskManager.Task::(prepare) Task=`2585f857-f7ad-4be6-82d3-f3237d10d141`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721192::DEBUG::2014-06-26 17:09:07,959::task::595::Storage.TaskManager.Task::(_updateState) Task=`2585f857-f7ad-4be6-82d3-f3237d10d141`::moving from state preparing -> state finished >Thread-721192::DEBUG::2014-06-26 17:09:07,959::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721192::DEBUG::2014-06-26 17:09:07,959::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721192::DEBUG::2014-06-26 17:09:07,960::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721192::DEBUG::2014-06-26 17:09:07,960::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721192::DEBUG::2014-06-26 17:09:07,960::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721192::DEBUG::2014-06-26 17:09:07,960::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721192::DEBUG::2014-06-26 17:09:07,960::task::993::Storage.TaskManager.Task::(_decref) Task=`2585f857-f7ad-4be6-82d3-f3237d10d141`::ref 0 aborting False >Thread-721192::DEBUG::2014-06-26 17:09:07,960::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:08,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:09,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119976 s, 85.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:09,246::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:09,246::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:09,246::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:09,246::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:09,247::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:09,247::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:09,247::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721193::DEBUG::2014-06-26 17:09:09,247::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721193::DEBUG::2014-06-26 17:09:09,252::task::595::Storage.TaskManager.Task::(_updateState) Task=`dbb06531-77c5-4c3f-9e2c-0d77283903b0`::moving from state init -> state preparing >Thread-721193::INFO::2014-06-26 17:09:09,253::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721193::INFO::2014-06-26 17:09:09,254::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000499643', 'lastCheck': '1.7', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000275578', 'lastCheck': '4.6', 'valid': True}} >Thread-721193::DEBUG::2014-06-26 17:09:09,254::task::1191::Storage.TaskManager.Task::(prepare) Task=`dbb06531-77c5-4c3f-9e2c-0d77283903b0`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000499643', 'lastCheck': '1.7', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000275578', 'lastCheck': '4.6', 'valid': True}} >Thread-721193::DEBUG::2014-06-26 17:09:09,255::task::595::Storage.TaskManager.Task::(_updateState) Task=`dbb06531-77c5-4c3f-9e2c-0d77283903b0`::moving from state preparing -> state finished >Thread-721193::DEBUG::2014-06-26 17:09:09,255::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721193::DEBUG::2014-06-26 17:09:09,256::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721193::DEBUG::2014-06-26 17:09:09,256::task::993::Storage.TaskManager.Task::(_decref) Task=`dbb06531-77c5-4c3f-9e2c-0d77283903b0`::ref 0 aborting False >Thread-721193::DEBUG::2014-06-26 17:09:09,261::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:09,296::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:09,296::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:09,296::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:09,296::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:09,296::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:09,297::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:09,297::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721194::DEBUG::2014-06-26 17:09:09,297::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721194::DEBUG::2014-06-26 17:09:09,298::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:11,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:11,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118381 s, 86.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:12,332::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:12,332::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:12,332::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:12,332::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:12,333::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:12,333::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:12,333::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721195::DEBUG::2014-06-26 17:09:12,334::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721195::DEBUG::2014-06-26 17:09:12,334::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:13,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:13,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120454 s, 85.0 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:09:14,665::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:09:14,672::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.00033395 s, 1.7 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:09:15,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:15,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118478 s, 86.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:15,347::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:15,347::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:15,347::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:15,348::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:15,348::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:15,348::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721196::DEBUG::2014-06-26 17:09:15,349::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:09:15,349::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721196::DEBUG::2014-06-26 17:09:15,350::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:17,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:17,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117776 s, 86.9 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:09:17,511::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:09:17,518::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000560036 s, 702 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:17,985::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:17,985::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:17,985::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:17,985::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:17,986::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:17,986::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:17,986::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721197::DEBUG::2014-06-26 17:09:17,987::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721197::DEBUG::2014-06-26 17:09:17,988::task::595::Storage.TaskManager.Task::(_updateState) Task=`735b0cb2-95ee-4fe5-8c8b-00dae4019724`::moving from state init -> state preparing >Thread-721197::INFO::2014-06-26 17:09:17,988::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721197::INFO::2014-06-26 17:09:17,988::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721197::DEBUG::2014-06-26 17:09:17,988::task::1191::Storage.TaskManager.Task::(prepare) Task=`735b0cb2-95ee-4fe5-8c8b-00dae4019724`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721197::DEBUG::2014-06-26 17:09:17,988::task::595::Storage.TaskManager.Task::(_updateState) Task=`735b0cb2-95ee-4fe5-8c8b-00dae4019724`::moving from state preparing -> state finished >Thread-721197::DEBUG::2014-06-26 17:09:17,988::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721197::DEBUG::2014-06-26 17:09:17,988::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721197::DEBUG::2014-06-26 17:09:17,988::task::993::Storage.TaskManager.Task::(_decref) Task=`735b0cb2-95ee-4fe5-8c8b-00dae4019724`::ref 0 aborting False >Thread-721197::DEBUG::2014-06-26 17:09:17,989::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:18,004::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:18,004::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:18,004::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:18,004::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:18,005::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:18,005::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:18,005::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721198::DEBUG::2014-06-26 17:09:18,005::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721198::DEBUG::2014-06-26 17:09:18,006::task::595::Storage.TaskManager.Task::(_updateState) Task=`14959201-8167-4140-a233-3a45d6629167`::moving from state init -> state preparing >Thread-721198::INFO::2014-06-26 17:09:18,006::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721198::DEBUG::2014-06-26 17:09:18,006::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`d3a9c963-55e3-4b63-b588-7b830b2362b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721198::DEBUG::2014-06-26 17:09:18,007::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721198::DEBUG::2014-06-26 17:09:18,007::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721198::DEBUG::2014-06-26 17:09:18,007::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`d3a9c963-55e3-4b63-b588-7b830b2362b7`::Granted request >Thread-721198::DEBUG::2014-06-26 17:09:18,007::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`14959201-8167-4140-a233-3a45d6629167`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721198::DEBUG::2014-06-26 17:09:18,007::task::993::Storage.TaskManager.Task::(_decref) Task=`14959201-8167-4140-a233-3a45d6629167`::ref 1 aborting False >Thread-721198::INFO::2014-06-26 17:09:18,009::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721198::DEBUG::2014-06-26 17:09:18,009::task::1191::Storage.TaskManager.Task::(prepare) Task=`14959201-8167-4140-a233-3a45d6629167`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721198::DEBUG::2014-06-26 17:09:18,010::task::595::Storage.TaskManager.Task::(_updateState) Task=`14959201-8167-4140-a233-3a45d6629167`::moving from state preparing -> state finished >Thread-721198::DEBUG::2014-06-26 17:09:18,010::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721198::DEBUG::2014-06-26 17:09:18,010::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721198::DEBUG::2014-06-26 17:09:18,010::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721198::DEBUG::2014-06-26 17:09:18,010::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721198::DEBUG::2014-06-26 17:09:18,010::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721198::DEBUG::2014-06-26 17:09:18,010::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721198::DEBUG::2014-06-26 17:09:18,010::task::993::Storage.TaskManager.Task::(_decref) Task=`14959201-8167-4140-a233-3a45d6629167`::ref 0 aborting False >Thread-721198::DEBUG::2014-06-26 17:09:18,011::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:18,362::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:18,362::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:18,362::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:18,362::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:18,362::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:18,362::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:18,363::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721199::DEBUG::2014-06-26 17:09:18,363::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721199::DEBUG::2014-06-26 17:09:18,364::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:19,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:21,374::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:21,374::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:21,375::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:21,375::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:21,375::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:21,375::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:21,376::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721200::DEBUG::2014-06-26 17:09:21,376::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721200::DEBUG::2014-06-26 17:09:21,377::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:21,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470025 s, 21.8 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:09:23,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:23,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117697 s, 87.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:24,389::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:24,389::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:24,389::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:24,389::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:24,390::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:24,390::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721201::DEBUG::2014-06-26 17:09:24,391::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:09:24,391::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721201::DEBUG::2014-06-26 17:09:24,392::task::595::Storage.TaskManager.Task::(_updateState) Task=`006e21df-3002-49d0-b99a-455e086ca234`::moving from state init -> state preparing >Thread-721201::INFO::2014-06-26 17:09:24,392::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721201::INFO::2014-06-26 17:09:24,392::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000560036', 'lastCheck': '6.9', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00033395', 'lastCheck': '9.7', 'valid': True}} >Thread-721201::DEBUG::2014-06-26 17:09:24,393::task::1191::Storage.TaskManager.Task::(prepare) Task=`006e21df-3002-49d0-b99a-455e086ca234`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000560036', 'lastCheck': '6.9', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00033395', 'lastCheck': '9.7', 'valid': True}} >Thread-721201::DEBUG::2014-06-26 17:09:24,393::task::595::Storage.TaskManager.Task::(_updateState) Task=`006e21df-3002-49d0-b99a-455e086ca234`::moving from state preparing -> state finished >Thread-721201::DEBUG::2014-06-26 17:09:24,393::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721201::DEBUG::2014-06-26 17:09:24,393::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721201::DEBUG::2014-06-26 17:09:24,393::task::993::Storage.TaskManager.Task::(_decref) Task=`006e21df-3002-49d0-b99a-455e086ca234`::ref 0 aborting False >Thread-721201::DEBUG::2014-06-26 17:09:24,395::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:24,427::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:24,427::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:24,427::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:24,428::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:24,428::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:24,428::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:24,428::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721202::DEBUG::2014-06-26 17:09:24,428::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721202::DEBUG::2014-06-26 17:09:24,429::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:09:24,674::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:09:24,681::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.00029334 s, 1.9 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:09:25,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:25,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118669 s, 86.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:27,464::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:27,465::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:27,465::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:27,465::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:27,465::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:27,465::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:27,466::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721203::DEBUG::2014-06-26 17:09:27,466::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721203::DEBUG::2014-06-26 17:09:27,467::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:09:27,521::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:09:27,528::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000446781 s, 880 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:09:27,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:27,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117035 s, 87.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:28,037::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:28,037::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:28,037::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:28,037::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:28,038::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:28,038::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:28,038::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721204::DEBUG::2014-06-26 17:09:28,038::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721204::DEBUG::2014-06-26 17:09:28,039::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a5cd11d-3a0a-4935-ac9f-ca8ecc4265f0`::moving from state init -> state preparing >Thread-721204::INFO::2014-06-26 17:09:28,039::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721204::INFO::2014-06-26 17:09:28,040::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721204::DEBUG::2014-06-26 17:09:28,040::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a5cd11d-3a0a-4935-ac9f-ca8ecc4265f0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721204::DEBUG::2014-06-26 17:09:28,040::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a5cd11d-3a0a-4935-ac9f-ca8ecc4265f0`::moving from state preparing -> state finished >Thread-721204::DEBUG::2014-06-26 17:09:28,040::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721204::DEBUG::2014-06-26 17:09:28,040::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721204::DEBUG::2014-06-26 17:09:28,040::task::993::Storage.TaskManager.Task::(_decref) Task=`0a5cd11d-3a0a-4935-ac9f-ca8ecc4265f0`::ref 0 aborting False >Thread-721204::DEBUG::2014-06-26 17:09:28,040::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:28,054::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:28,055::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:28,055::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:28,055::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:28,055::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:28,055::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:28,056::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721205::DEBUG::2014-06-26 17:09:28,056::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721205::DEBUG::2014-06-26 17:09:28,056::task::595::Storage.TaskManager.Task::(_updateState) Task=`c829f3a1-292d-4f52-b8f1-956d205f66bb`::moving from state init -> state preparing >Thread-721205::INFO::2014-06-26 17:09:28,056::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721205::DEBUG::2014-06-26 17:09:28,057::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`31781cfd-fefa-4a2e-8de4-37e8bc6fe752`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721205::DEBUG::2014-06-26 17:09:28,057::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721205::DEBUG::2014-06-26 17:09:28,057::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721205::DEBUG::2014-06-26 17:09:28,057::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`31781cfd-fefa-4a2e-8de4-37e8bc6fe752`::Granted request >Thread-721205::DEBUG::2014-06-26 17:09:28,057::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c829f3a1-292d-4f52-b8f1-956d205f66bb`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721205::DEBUG::2014-06-26 17:09:28,057::task::993::Storage.TaskManager.Task::(_decref) Task=`c829f3a1-292d-4f52-b8f1-956d205f66bb`::ref 1 aborting False >Thread-721205::INFO::2014-06-26 17:09:28,059::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721205::DEBUG::2014-06-26 17:09:28,060::task::1191::Storage.TaskManager.Task::(prepare) Task=`c829f3a1-292d-4f52-b8f1-956d205f66bb`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8417968128', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721205::DEBUG::2014-06-26 17:09:28,060::task::595::Storage.TaskManager.Task::(_updateState) Task=`c829f3a1-292d-4f52-b8f1-956d205f66bb`::moving from state preparing -> state finished >Thread-721205::DEBUG::2014-06-26 17:09:28,060::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721205::DEBUG::2014-06-26 17:09:28,060::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721205::DEBUG::2014-06-26 17:09:28,060::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721205::DEBUG::2014-06-26 17:09:28,060::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721205::DEBUG::2014-06-26 17:09:28,060::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721205::DEBUG::2014-06-26 17:09:28,060::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721205::DEBUG::2014-06-26 17:09:28,060::task::993::Storage.TaskManager.Task::(_decref) Task=`c829f3a1-292d-4f52-b8f1-956d205f66bb`::ref 0 aborting False >Thread-721205::DEBUG::2014-06-26 17:09:28,061::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:29,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:29,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118942 s, 86.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:30,480::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:30,480::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:30,480::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:30,480::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:30,480::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:30,480::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:30,481::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721206::DEBUG::2014-06-26 17:09:30,481::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721206::DEBUG::2014-06-26 17:09:30,482::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:31,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:31,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120104 s, 85.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:33,493::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:33,493::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:33,493::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:33,494::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:33,494::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:33,494::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:33,495::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721207::DEBUG::2014-06-26 17:09:33,495::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721207::DEBUG::2014-06-26 17:09:33,496::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:33,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:33,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011722 s, 87.4 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:09:34,684::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:09:34,690::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000239577 s, 2.3 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:09:35,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:35,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012097 s, 84.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:36,509::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:36,509::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:36,510::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:36,510::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:36,511::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:36,512::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:36,513::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721208::DEBUG::2014-06-26 17:09:36,514::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721208::DEBUG::2014-06-26 17:09:36,517::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:09:37,531::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:09:37,538::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000630658 s, 623 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:09:37,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:37,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120609 s, 84.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:38,087::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:38,087::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:38,087::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:38,087::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:38,087::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:38,088::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:38,088::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721209::DEBUG::2014-06-26 17:09:38,088::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721209::DEBUG::2014-06-26 17:09:38,089::task::595::Storage.TaskManager.Task::(_updateState) Task=`51daccdc-8818-4b3e-8555-edeedbee5f6d`::moving from state init -> state preparing >Thread-721209::INFO::2014-06-26 17:09:38,089::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721209::INFO::2014-06-26 17:09:38,090::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721209::DEBUG::2014-06-26 17:09:38,090::task::1191::Storage.TaskManager.Task::(prepare) Task=`51daccdc-8818-4b3e-8555-edeedbee5f6d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721209::DEBUG::2014-06-26 17:09:38,090::task::595::Storage.TaskManager.Task::(_updateState) Task=`51daccdc-8818-4b3e-8555-edeedbee5f6d`::moving from state preparing -> state finished >Thread-721209::DEBUG::2014-06-26 17:09:38,090::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721209::DEBUG::2014-06-26 17:09:38,090::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721209::DEBUG::2014-06-26 17:09:38,090::task::993::Storage.TaskManager.Task::(_decref) Task=`51daccdc-8818-4b3e-8555-edeedbee5f6d`::ref 0 aborting False >Thread-721209::DEBUG::2014-06-26 17:09:38,090::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:38,104::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:38,104::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:38,105::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:38,105::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:38,105::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:38,105::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:38,105::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721210::DEBUG::2014-06-26 17:09:38,105::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721210::DEBUG::2014-06-26 17:09:38,106::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbed6910-cfee-42da-8a6a-58185106be9b`::moving from state init -> state preparing >Thread-721210::INFO::2014-06-26 17:09:38,106::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721210::DEBUG::2014-06-26 17:09:38,107::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`9d20a52c-8c41-4271-9430-7eda65191b49`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721210::DEBUG::2014-06-26 17:09:38,107::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721210::DEBUG::2014-06-26 17:09:38,107::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721210::DEBUG::2014-06-26 17:09:38,107::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`9d20a52c-8c41-4271-9430-7eda65191b49`::Granted request >Thread-721210::DEBUG::2014-06-26 17:09:38,107::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fbed6910-cfee-42da-8a6a-58185106be9b`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721210::DEBUG::2014-06-26 17:09:38,107::task::993::Storage.TaskManager.Task::(_decref) Task=`fbed6910-cfee-42da-8a6a-58185106be9b`::ref 1 aborting False >Thread-721210::INFO::2014-06-26 17:09:38,110::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721210::DEBUG::2014-06-26 17:09:38,110::task::1191::Storage.TaskManager.Task::(prepare) Task=`fbed6910-cfee-42da-8a6a-58185106be9b`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721210::DEBUG::2014-06-26 17:09:38,110::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbed6910-cfee-42da-8a6a-58185106be9b`::moving from state preparing -> state finished >Thread-721210::DEBUG::2014-06-26 17:09:38,110::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721210::DEBUG::2014-06-26 17:09:38,110::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721210::DEBUG::2014-06-26 17:09:38,110::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721210::DEBUG::2014-06-26 17:09:38,110::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721210::DEBUG::2014-06-26 17:09:38,110::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721210::DEBUG::2014-06-26 17:09:38,110::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721210::DEBUG::2014-06-26 17:09:38,110::task::993::Storage.TaskManager.Task::(_decref) Task=`fbed6910-cfee-42da-8a6a-58185106be9b`::ref 0 aborting False >Thread-721210::DEBUG::2014-06-26 17:09:38,111::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:39,530::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:39,530::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:39,530::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:39,530::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:39,531::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:39,531::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721211::DEBUG::2014-06-26 17:09:39,531::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:09:39,531::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721211::DEBUG::2014-06-26 17:09:39,533::task::595::Storage.TaskManager.Task::(_updateState) Task=`68012503-8e53-4e58-bac6-dc89d2d9959f`::moving from state init -> state preparing >Thread-721211::INFO::2014-06-26 17:09:39,533::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721211::INFO::2014-06-26 17:09:39,533::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000630658', 'lastCheck': '2.0', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000239577', 'lastCheck': '4.8', 'valid': True}} >Thread-721211::DEBUG::2014-06-26 17:09:39,533::task::1191::Storage.TaskManager.Task::(prepare) Task=`68012503-8e53-4e58-bac6-dc89d2d9959f`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000630658', 'lastCheck': '2.0', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000239577', 'lastCheck': '4.8', 'valid': True}} >Thread-721211::DEBUG::2014-06-26 17:09:39,533::task::595::Storage.TaskManager.Task::(_updateState) Task=`68012503-8e53-4e58-bac6-dc89d2d9959f`::moving from state preparing -> state finished >Thread-721211::DEBUG::2014-06-26 17:09:39,533::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721211::DEBUG::2014-06-26 17:09:39,533::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721211::DEBUG::2014-06-26 17:09:39,533::task::993::Storage.TaskManager.Task::(_decref) Task=`68012503-8e53-4e58-bac6-dc89d2d9959f`::ref 0 aborting False >Thread-721211::DEBUG::2014-06-26 17:09:39,536::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:39,569::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:39,569::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:39,569::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:39,569::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:39,569::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:39,570::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:39,570::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721212::DEBUG::2014-06-26 17:09:39,570::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721212::DEBUG::2014-06-26 17:09:39,571::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:39,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:39,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121299 s, 84.4 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:09:41,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:42,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0190891 s, 53.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:42,612::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:42,612::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:42,612::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:42,612::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:42,612::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:42,613::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:42,613::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721213::DEBUG::2014-06-26 17:09:42,613::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721213::DEBUG::2014-06-26 17:09:42,614::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:44,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:44,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012099 s, 84.6 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:09:44,693::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:09:44,699::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000251506 s, 2.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:45,625::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:45,625::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:45,626::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:45,626::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:45,626::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:45,626::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:45,627::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721214::DEBUG::2014-06-26 17:09:45,627::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721214::DEBUG::2014-06-26 17:09:45,628::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:46,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:46,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119683 s, 85.6 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:09:47,540::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:09:47,548::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000636952 s, 617 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:48,135::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:48,135::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:48,135::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:48,135::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:48,135::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:48,136::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:48,136::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721215::DEBUG::2014-06-26 17:09:48,136::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721215::DEBUG::2014-06-26 17:09:48,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e31b18d-cb97-4b07-8268-72dac449a7ad`::moving from state init -> state preparing >Thread-721215::INFO::2014-06-26 17:09:48,137::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721215::INFO::2014-06-26 17:09:48,138::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721215::DEBUG::2014-06-26 17:09:48,138::task::1191::Storage.TaskManager.Task::(prepare) Task=`9e31b18d-cb97-4b07-8268-72dac449a7ad`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721215::DEBUG::2014-06-26 17:09:48,138::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e31b18d-cb97-4b07-8268-72dac449a7ad`::moving from state preparing -> state finished >Thread-721215::DEBUG::2014-06-26 17:09:48,138::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721215::DEBUG::2014-06-26 17:09:48,138::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721215::DEBUG::2014-06-26 17:09:48,138::task::993::Storage.TaskManager.Task::(_decref) Task=`9e31b18d-cb97-4b07-8268-72dac449a7ad`::ref 0 aborting False >Thread-721215::DEBUG::2014-06-26 17:09:48,138::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:48,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:48,158::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:48,158::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:48,158::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:48,158::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:48,158::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:48,159::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:48,159::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721216::DEBUG::2014-06-26 17:09:48,159::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721216::DEBUG::2014-06-26 17:09:48,160::task::595::Storage.TaskManager.Task::(_updateState) Task=`0aa9fd2d-e946-4c67-b31e-28d35ba3d09f`::moving from state init -> state preparing >Thread-721216::INFO::2014-06-26 17:09:48,160::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721216::DEBUG::2014-06-26 17:09:48,161::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`fcb1a179-6ca3-4740-a1f2-2d856e5d6c4b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721216::DEBUG::2014-06-26 17:09:48,161::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721216::DEBUG::2014-06-26 17:09:48,161::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721216::DEBUG::2014-06-26 17:09:48,161::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`fcb1a179-6ca3-4740-a1f2-2d856e5d6c4b`::Granted request >Thread-721216::DEBUG::2014-06-26 17:09:48,161::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0aa9fd2d-e946-4c67-b31e-28d35ba3d09f`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721216::DEBUG::2014-06-26 17:09:48,161::task::993::Storage.TaskManager.Task::(_decref) Task=`0aa9fd2d-e946-4c67-b31e-28d35ba3d09f`::ref 1 aborting False >Thread-721216::INFO::2014-06-26 17:09:48,164::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721216::DEBUG::2014-06-26 17:09:48,164::task::1191::Storage.TaskManager.Task::(prepare) Task=`0aa9fd2d-e946-4c67-b31e-28d35ba3d09f`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721216::DEBUG::2014-06-26 17:09:48,164::task::595::Storage.TaskManager.Task::(_updateState) Task=`0aa9fd2d-e946-4c67-b31e-28d35ba3d09f`::moving from state preparing -> state finished >Thread-721216::DEBUG::2014-06-26 17:09:48,164::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721216::DEBUG::2014-06-26 17:09:48,164::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721216::DEBUG::2014-06-26 17:09:48,164::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721216::DEBUG::2014-06-26 17:09:48,164::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721216::DEBUG::2014-06-26 17:09:48,165::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721216::DEBUG::2014-06-26 17:09:48,165::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721216::DEBUG::2014-06-26 17:09:48,165::task::993::Storage.TaskManager.Task::(_decref) Task=`0aa9fd2d-e946-4c67-b31e-28d35ba3d09f`::ref 0 aborting False >Thread-721216::DEBUG::2014-06-26 17:09:48,165::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:48,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011615 s, 88.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:48,640::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:48,640::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:48,640::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:48,640::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:48,640::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:48,640::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721217::DEBUG::2014-06-26 17:09:48,641::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:09:48,641::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721217::DEBUG::2014-06-26 17:09:48,642::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:50,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:50,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119729 s, 85.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:51,654::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:51,654::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:51,654::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:51,654::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:51,655::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:51,655::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:51,655::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721218::DEBUG::2014-06-26 17:09:51,655::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721218::DEBUG::2014-06-26 17:09:51,656::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:52,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:52,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120563 s, 84.9 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:09:54,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:54,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117471 s, 87.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:54,666::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:54,666::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:54,666::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:54,666::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:54,667::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:54,667::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721219::DEBUG::2014-06-26 17:09:54,667::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:09:54,667::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721219::DEBUG::2014-06-26 17:09:54,669::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fc026a4-4aa0-4b37-a019-0eda9f172b06`::moving from state init -> state preparing >Thread-721219::INFO::2014-06-26 17:09:54,669::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721219::INFO::2014-06-26 17:09:54,669::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000636952', 'lastCheck': '7.1', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000251506', 'lastCheck': '10.0', 'valid': True}} >Thread-721219::DEBUG::2014-06-26 17:09:54,669::task::1191::Storage.TaskManager.Task::(prepare) Task=`8fc026a4-4aa0-4b37-a019-0eda9f172b06`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000636952', 'lastCheck': '7.1', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000251506', 'lastCheck': '10.0', 'valid': True}} >Thread-721219::DEBUG::2014-06-26 17:09:54,670::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fc026a4-4aa0-4b37-a019-0eda9f172b06`::moving from state preparing -> state finished >Thread-721219::DEBUG::2014-06-26 17:09:54,670::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721219::DEBUG::2014-06-26 17:09:54,670::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721219::DEBUG::2014-06-26 17:09:54,670::task::993::Storage.TaskManager.Task::(_decref) Task=`8fc026a4-4aa0-4b37-a019-0eda9f172b06`::ref 0 aborting False >Thread-721219::DEBUG::2014-06-26 17:09:54,672::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:54,700::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:54,700::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:54,700::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:54,700::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:54,700::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:54,701::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:09:54,701::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721220::DEBUG::2014-06-26 17:09:54,701::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-160::DEBUG::2014-06-26 17:09:54,703::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-721220::DEBUG::2014-06-26 17:09:54,710::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:09:54,712::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000191124 s, 2.9 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:09:56,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:56,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119351 s, 85.8 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:09:57,550::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:09:57,557::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000394632 s, 996 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:57,744::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:57,744::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:57,744::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:57,744::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:57,744::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:57,744::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721221::DEBUG::2014-06-26 17:09:57,745::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:09:57,745::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721221::DEBUG::2014-06-26 17:09:57,746::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:58,189::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:58,189::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:58,189::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:58,189::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:58,189::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:58,189::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721222::DEBUG::2014-06-26 17:09:58,190::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:09:58,190::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721222::DEBUG::2014-06-26 17:09:58,191::task::595::Storage.TaskManager.Task::(_updateState) Task=`89e8b5f1-fff9-42a3-b078-aca17192685f`::moving from state init -> state preparing >Thread-721222::INFO::2014-06-26 17:09:58,191::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721222::INFO::2014-06-26 17:09:58,191::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721222::DEBUG::2014-06-26 17:09:58,191::task::1191::Storage.TaskManager.Task::(prepare) Task=`89e8b5f1-fff9-42a3-b078-aca17192685f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721222::DEBUG::2014-06-26 17:09:58,191::task::595::Storage.TaskManager.Task::(_updateState) Task=`89e8b5f1-fff9-42a3-b078-aca17192685f`::moving from state preparing -> state finished >Thread-721222::DEBUG::2014-06-26 17:09:58,191::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721222::DEBUG::2014-06-26 17:09:58,192::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721222::DEBUG::2014-06-26 17:09:58,192::task::993::Storage.TaskManager.Task::(_decref) Task=`89e8b5f1-fff9-42a3-b078-aca17192685f`::ref 0 aborting False >Thread-721222::DEBUG::2014-06-26 17:09:58,192::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:58,201::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:58,202::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:58,202::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:09:58,202::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:09:58,202::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:09:58,202::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721223::DEBUG::2014-06-26 17:09:58,203::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:09:58,203::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721223::DEBUG::2014-06-26 17:09:58,203::task::595::Storage.TaskManager.Task::(_updateState) Task=`cee9c82d-59a9-407c-9103-f945623c548e`::moving from state init -> state preparing >Thread-721223::INFO::2014-06-26 17:09:58,203::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721223::DEBUG::2014-06-26 17:09:58,204::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`a34cb221-4a51-449c-83a1-5082da2bb9d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721223::DEBUG::2014-06-26 17:09:58,204::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721223::DEBUG::2014-06-26 17:09:58,204::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721223::DEBUG::2014-06-26 17:09:58,204::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`a34cb221-4a51-449c-83a1-5082da2bb9d7`::Granted request >Thread-721223::DEBUG::2014-06-26 17:09:58,204::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cee9c82d-59a9-407c-9103-f945623c548e`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721223::DEBUG::2014-06-26 17:09:58,204::task::993::Storage.TaskManager.Task::(_decref) Task=`cee9c82d-59a9-407c-9103-f945623c548e`::ref 1 aborting False >Thread-721223::INFO::2014-06-26 17:09:58,207::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721223::DEBUG::2014-06-26 17:09:58,207::task::1191::Storage.TaskManager.Task::(prepare) Task=`cee9c82d-59a9-407c-9103-f945623c548e`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721223::DEBUG::2014-06-26 17:09:58,207::task::595::Storage.TaskManager.Task::(_updateState) Task=`cee9c82d-59a9-407c-9103-f945623c548e`::moving from state preparing -> state finished >Thread-721223::DEBUG::2014-06-26 17:09:58,207::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721223::DEBUG::2014-06-26 17:09:58,207::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721223::DEBUG::2014-06-26 17:09:58,207::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721223::DEBUG::2014-06-26 17:09:58,207::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721223::DEBUG::2014-06-26 17:09:58,207::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721223::DEBUG::2014-06-26 17:09:58,207::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721223::DEBUG::2014-06-26 17:09:58,207::task::993::Storage.TaskManager.Task::(_decref) Task=`cee9c82d-59a9-407c-9103-f945623c548e`::ref 0 aborting False >Thread-721223::DEBUG::2014-06-26 17:09:58,208::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:09:58,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:09:58,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118606 s, 86.3 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:10:00,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:00,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118947 s, 86.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:00,756::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:00,756::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:00,756::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:00,757::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:00,757::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:00,757::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:00,758::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721224::DEBUG::2014-06-26 17:10:00,758::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721224::DEBUG::2014-06-26 17:10:00,759::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:02,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:02,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118282 s, 86.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:03,769::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:03,769::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:03,769::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:03,769::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:03,770::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:03,770::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:03,770::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721225::DEBUG::2014-06-26 17:10:03,771::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721225::DEBUG::2014-06-26 17:10:03,772::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:04,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:04,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117037 s, 87.5 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:10:04,715::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:10:04,721::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000221446 s, 2.5 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:10:06,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:06,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243097 s, 42.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:06,779::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:06,779::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:06,780::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:06,780::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:06,781::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:06,782::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721226::DEBUG::2014-06-26 17:10:06,783::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:10:06,783::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721226::DEBUG::2014-06-26 17:10:06,786::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:10:07,560::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:10:07,567::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000404104 s, 973 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:08,224::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:08,224::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:08,225::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:08,225::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:08,225::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:08,225::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:08,226::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721227::DEBUG::2014-06-26 17:10:08,226::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721227::DEBUG::2014-06-26 17:10:08,227::task::595::Storage.TaskManager.Task::(_updateState) Task=`106e4d3e-bb31-4657-b156-f73ec9f46472`::moving from state init -> state preparing >Thread-721227::INFO::2014-06-26 17:10:08,227::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721227::INFO::2014-06-26 17:10:08,227::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721227::DEBUG::2014-06-26 17:10:08,227::task::1191::Storage.TaskManager.Task::(prepare) Task=`106e4d3e-bb31-4657-b156-f73ec9f46472`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721227::DEBUG::2014-06-26 17:10:08,227::task::595::Storage.TaskManager.Task::(_updateState) Task=`106e4d3e-bb31-4657-b156-f73ec9f46472`::moving from state preparing -> state finished >Thread-721227::DEBUG::2014-06-26 17:10:08,227::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721227::DEBUG::2014-06-26 17:10:08,227::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721227::DEBUG::2014-06-26 17:10:08,228::task::993::Storage.TaskManager.Task::(_decref) Task=`106e4d3e-bb31-4657-b156-f73ec9f46472`::ref 0 aborting False >Thread-721227::DEBUG::2014-06-26 17:10:08,228::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:08,238::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:08,238::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:08,238::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:08,238::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:08,238::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:08,239::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:08,239::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721228::DEBUG::2014-06-26 17:10:08,239::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721228::DEBUG::2014-06-26 17:10:08,240::task::595::Storage.TaskManager.Task::(_updateState) Task=`c35d2df7-a4cb-4dc4-8e06-ea5513d1076a`::moving from state init -> state preparing >Thread-721228::INFO::2014-06-26 17:10:08,240::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721228::DEBUG::2014-06-26 17:10:08,259::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`743e78e6-27ff-4d14-be9f-5a7ad30b69c5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721228::DEBUG::2014-06-26 17:10:08,259::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721228::DEBUG::2014-06-26 17:10:08,259::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721228::DEBUG::2014-06-26 17:10:08,259::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`743e78e6-27ff-4d14-be9f-5a7ad30b69c5`::Granted request >Thread-721228::DEBUG::2014-06-26 17:10:08,259::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c35d2df7-a4cb-4dc4-8e06-ea5513d1076a`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721228::DEBUG::2014-06-26 17:10:08,259::task::993::Storage.TaskManager.Task::(_decref) Task=`c35d2df7-a4cb-4dc4-8e06-ea5513d1076a`::ref 1 aborting False >Thread-721228::INFO::2014-06-26 17:10:08,262::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721228::DEBUG::2014-06-26 17:10:08,262::task::1191::Storage.TaskManager.Task::(prepare) Task=`c35d2df7-a4cb-4dc4-8e06-ea5513d1076a`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721228::DEBUG::2014-06-26 17:10:08,262::task::595::Storage.TaskManager.Task::(_updateState) Task=`c35d2df7-a4cb-4dc4-8e06-ea5513d1076a`::moving from state preparing -> state finished >Thread-721228::DEBUG::2014-06-26 17:10:08,262::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721228::DEBUG::2014-06-26 17:10:08,263::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721228::DEBUG::2014-06-26 17:10:08,263::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721228::DEBUG::2014-06-26 17:10:08,263::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721228::DEBUG::2014-06-26 17:10:08,263::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721228::DEBUG::2014-06-26 17:10:08,263::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721228::DEBUG::2014-06-26 17:10:08,263::task::993::Storage.TaskManager.Task::(_decref) Task=`c35d2df7-a4cb-4dc4-8e06-ea5513d1076a`::ref 0 aborting False >Thread-721228::DEBUG::2014-06-26 17:10:08,263::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:08,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:08,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120173 s, 85.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:09,797::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:09,797::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:09,797::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:09,797::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:09,797::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:09,797::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:09,798::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721229::DEBUG::2014-06-26 17:10:09,798::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721229::DEBUG::2014-06-26 17:10:09,800::task::595::Storage.TaskManager.Task::(_updateState) Task=`16038d95-7cf5-48db-9626-a4dbe00a2ad3`::moving from state init -> state preparing >Thread-721229::INFO::2014-06-26 17:10:09,800::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721229::INFO::2014-06-26 17:10:09,800::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000404104', 'lastCheck': '2.2', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000221446', 'lastCheck': '5.1', 'valid': True}} >Thread-721229::DEBUG::2014-06-26 17:10:09,800::task::1191::Storage.TaskManager.Task::(prepare) Task=`16038d95-7cf5-48db-9626-a4dbe00a2ad3`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000404104', 'lastCheck': '2.2', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000221446', 'lastCheck': '5.1', 'valid': True}} >Thread-721229::DEBUG::2014-06-26 17:10:09,800::task::595::Storage.TaskManager.Task::(_updateState) Task=`16038d95-7cf5-48db-9626-a4dbe00a2ad3`::moving from state preparing -> state finished >Thread-721229::DEBUG::2014-06-26 17:10:09,800::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721229::DEBUG::2014-06-26 17:10:09,800::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721229::DEBUG::2014-06-26 17:10:09,800::task::993::Storage.TaskManager.Task::(_decref) Task=`16038d95-7cf5-48db-9626-a4dbe00a2ad3`::ref 0 aborting False >Thread-721229::DEBUG::2014-06-26 17:10:09,802::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:09,823::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:09,824::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:09,824::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:09,824::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:09,824::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:09,824::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:09,824::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721230::DEBUG::2014-06-26 17:10:09,824::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721230::DEBUG::2014-06-26 17:10:09,825::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:10,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:10,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116471 s, 87.9 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:10:12,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:12,853::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:12,853::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:12,853::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:12,853::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:12,853::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:12,854::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721231::DEBUG::2014-06-26 17:10:12,854::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:10:12,854::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721231::DEBUG::2014-06-26 17:10:12,856::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:12,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116588 s, 87.8 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:10:14,724::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:10:14,731::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000234879 s, 2.4 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:10:14,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:14,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114427 s, 89.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:15,866::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:15,866::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:15,867::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:15,867::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:15,867::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:15,867::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:15,867::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721232::DEBUG::2014-06-26 17:10:15,867::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721232::DEBUG::2014-06-26 17:10:15,868::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:16,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:16,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118507 s, 86.4 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:10:17,569::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:10:17,576::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000480727 s, 818 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:18,282::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:18,282::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:18,282::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:18,282::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:18,283::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:18,283::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:18,283::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721233::DEBUG::2014-06-26 17:10:18,283::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721233::DEBUG::2014-06-26 17:10:18,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`d84854bf-2fc1-45a1-a605-7bea441fb8d3`::moving from state init -> state preparing >Thread-721233::INFO::2014-06-26 17:10:18,285::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721233::INFO::2014-06-26 17:10:18,285::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721233::DEBUG::2014-06-26 17:10:18,285::task::1191::Storage.TaskManager.Task::(prepare) Task=`d84854bf-2fc1-45a1-a605-7bea441fb8d3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721233::DEBUG::2014-06-26 17:10:18,285::task::595::Storage.TaskManager.Task::(_updateState) Task=`d84854bf-2fc1-45a1-a605-7bea441fb8d3`::moving from state preparing -> state finished >Thread-721233::DEBUG::2014-06-26 17:10:18,285::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721233::DEBUG::2014-06-26 17:10:18,285::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721233::DEBUG::2014-06-26 17:10:18,285::task::993::Storage.TaskManager.Task::(_decref) Task=`d84854bf-2fc1-45a1-a605-7bea441fb8d3`::ref 0 aborting False >Thread-721233::DEBUG::2014-06-26 17:10:18,285::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:18,301::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:18,301::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:18,301::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:18,301::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:18,301::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:18,301::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:18,302::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721234::DEBUG::2014-06-26 17:10:18,302::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721234::DEBUG::2014-06-26 17:10:18,302::task::595::Storage.TaskManager.Task::(_updateState) Task=`817f983d-a3fd-49fc-a5e8-3c4985a6efc5`::moving from state init -> state preparing >Thread-721234::INFO::2014-06-26 17:10:18,303::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721234::DEBUG::2014-06-26 17:10:18,303::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`6bdf3f00-fb5a-4225-80d0-962ad3369116`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721234::DEBUG::2014-06-26 17:10:18,303::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721234::DEBUG::2014-06-26 17:10:18,303::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721234::DEBUG::2014-06-26 17:10:18,303::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`6bdf3f00-fb5a-4225-80d0-962ad3369116`::Granted request >Thread-721234::DEBUG::2014-06-26 17:10:18,303::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`817f983d-a3fd-49fc-a5e8-3c4985a6efc5`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721234::DEBUG::2014-06-26 17:10:18,304::task::993::Storage.TaskManager.Task::(_decref) Task=`817f983d-a3fd-49fc-a5e8-3c4985a6efc5`::ref 1 aborting False >Thread-721234::INFO::2014-06-26 17:10:18,306::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721234::DEBUG::2014-06-26 17:10:18,306::task::1191::Storage.TaskManager.Task::(prepare) Task=`817f983d-a3fd-49fc-a5e8-3c4985a6efc5`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721234::DEBUG::2014-06-26 17:10:18,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`817f983d-a3fd-49fc-a5e8-3c4985a6efc5`::moving from state preparing -> state finished >Thread-721234::DEBUG::2014-06-26 17:10:18,306::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721234::DEBUG::2014-06-26 17:10:18,306::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721234::DEBUG::2014-06-26 17:10:18,306::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721234::DEBUG::2014-06-26 17:10:18,307::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721234::DEBUG::2014-06-26 17:10:18,307::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721234::DEBUG::2014-06-26 17:10:18,307::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721234::DEBUG::2014-06-26 17:10:18,307::task::993::Storage.TaskManager.Task::(_decref) Task=`817f983d-a3fd-49fc-a5e8-3c4985a6efc5`::ref 0 aborting False >Thread-721234::DEBUG::2014-06-26 17:10:18,307::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:18,879::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:18,880::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:18,880::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:18,880::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:18,880::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:18,880::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:18,880::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721235::DEBUG::2014-06-26 17:10:18,881::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721235::DEBUG::2014-06-26 17:10:18,881::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:19,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:19,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115375 s, 88.8 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:10:21,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:21,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115854 s, 88.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:21,894::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:21,894::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:21,894::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:21,894::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:21,894::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:21,894::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:21,895::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721236::DEBUG::2014-06-26 17:10:21,895::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721236::DEBUG::2014-06-26 17:10:21,896::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:23,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:23,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0162138 s, 63.2 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:10:24,733::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:10:24,740::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000246252 s, 2.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:24,910::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:24,910::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:24,910::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:24,910::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:24,910::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:24,911::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:24,911::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721237::DEBUG::2014-06-26 17:10:24,911::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721237::DEBUG::2014-06-26 17:10:24,913::task::595::Storage.TaskManager.Task::(_updateState) Task=`98e7a05c-0cfb-4e89-ae5d-c98c242ab33c`::moving from state init -> state preparing >Thread-721237::INFO::2014-06-26 17:10:24,913::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721237::INFO::2014-06-26 17:10:24,913::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000480727', 'lastCheck': '7.3', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246252', 'lastCheck': '0.2', 'valid': True}} >Thread-721237::DEBUG::2014-06-26 17:10:24,913::task::1191::Storage.TaskManager.Task::(prepare) Task=`98e7a05c-0cfb-4e89-ae5d-c98c242ab33c`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000480727', 'lastCheck': '7.3', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246252', 'lastCheck': '0.2', 'valid': True}} >Thread-721237::DEBUG::2014-06-26 17:10:24,913::task::595::Storage.TaskManager.Task::(_updateState) Task=`98e7a05c-0cfb-4e89-ae5d-c98c242ab33c`::moving from state preparing -> state finished >Thread-721237::DEBUG::2014-06-26 17:10:24,913::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721237::DEBUG::2014-06-26 17:10:24,913::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721237::DEBUG::2014-06-26 17:10:24,913::task::993::Storage.TaskManager.Task::(_decref) Task=`98e7a05c-0cfb-4e89-ae5d-c98c242ab33c`::ref 0 aborting False >Thread-721237::DEBUG::2014-06-26 17:10:24,915::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:24,950::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:24,950::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:24,951::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:24,951::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:24,951::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:24,951::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:24,951::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721238::DEBUG::2014-06-26 17:10:24,951::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721238::DEBUG::2014-06-26 17:10:24,952::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:25,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:25,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118444 s, 86.5 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:10:27,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:27,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117184 s, 87.4 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:10:27,579::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:10:27,587::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000524524 s, 749 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:27,990::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:27,990::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:27,990::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:27,990::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:27,990::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:27,991::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:27,991::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721239::DEBUG::2014-06-26 17:10:27,991::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721239::DEBUG::2014-06-26 17:10:27,992::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:28,333::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:28,333::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:28,333::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:28,333::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:28,333::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:28,333::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721240::DEBUG::2014-06-26 17:10:28,334::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:10:28,334::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721240::DEBUG::2014-06-26 17:10:28,335::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b1735f6-1999-4fe1-b697-c09e1ad2406c`::moving from state init -> state preparing >Thread-721240::INFO::2014-06-26 17:10:28,335::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721240::INFO::2014-06-26 17:10:28,335::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721240::DEBUG::2014-06-26 17:10:28,335::task::1191::Storage.TaskManager.Task::(prepare) Task=`0b1735f6-1999-4fe1-b697-c09e1ad2406c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721240::DEBUG::2014-06-26 17:10:28,335::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b1735f6-1999-4fe1-b697-c09e1ad2406c`::moving from state preparing -> state finished >Thread-721240::DEBUG::2014-06-26 17:10:28,335::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721240::DEBUG::2014-06-26 17:10:28,336::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721240::DEBUG::2014-06-26 17:10:28,336::task::993::Storage.TaskManager.Task::(_decref) Task=`0b1735f6-1999-4fe1-b697-c09e1ad2406c`::ref 0 aborting False >Thread-721240::DEBUG::2014-06-26 17:10:28,336::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:28,349::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:28,349::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:28,349::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:28,350::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:28,350::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:28,350::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:28,350::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721241::DEBUG::2014-06-26 17:10:28,350::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721241::DEBUG::2014-06-26 17:10:28,351::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7991fc8-9a34-4eca-98f7-a28fadf30505`::moving from state init -> state preparing >Thread-721241::INFO::2014-06-26 17:10:28,351::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721241::DEBUG::2014-06-26 17:10:28,351::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`d20f8c27-1f85-438a-b13c-499cb96b09c4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721241::DEBUG::2014-06-26 17:10:28,351::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721241::DEBUG::2014-06-26 17:10:28,352::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721241::DEBUG::2014-06-26 17:10:28,352::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`d20f8c27-1f85-438a-b13c-499cb96b09c4`::Granted request >Thread-721241::DEBUG::2014-06-26 17:10:28,352::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f7991fc8-9a34-4eca-98f7-a28fadf30505`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721241::DEBUG::2014-06-26 17:10:28,352::task::993::Storage.TaskManager.Task::(_decref) Task=`f7991fc8-9a34-4eca-98f7-a28fadf30505`::ref 1 aborting False >Thread-721241::INFO::2014-06-26 17:10:28,354::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721241::DEBUG::2014-06-26 17:10:28,354::task::1191::Storage.TaskManager.Task::(prepare) Task=`f7991fc8-9a34-4eca-98f7-a28fadf30505`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721241::DEBUG::2014-06-26 17:10:28,354::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7991fc8-9a34-4eca-98f7-a28fadf30505`::moving from state preparing -> state finished >Thread-721241::DEBUG::2014-06-26 17:10:28,355::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721241::DEBUG::2014-06-26 17:10:28,355::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721241::DEBUG::2014-06-26 17:10:28,355::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721241::DEBUG::2014-06-26 17:10:28,355::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721241::DEBUG::2014-06-26 17:10:28,355::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721241::DEBUG::2014-06-26 17:10:28,355::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721241::DEBUG::2014-06-26 17:10:28,355::task::993::Storage.TaskManager.Task::(_decref) Task=`f7991fc8-9a34-4eca-98f7-a28fadf30505`::ref 0 aborting False >Thread-721241::DEBUG::2014-06-26 17:10:28,356::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:29,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:29,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115595 s, 88.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:31,004::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:31,005::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:31,005::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:31,005::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:31,005::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:31,005::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721242::DEBUG::2014-06-26 17:10:31,006::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:10:31,006::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721242::DEBUG::2014-06-26 17:10:31,007::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:31,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:31,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0150758 s, 67.9 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:10:33,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:33,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117491 s, 87.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:34,019::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:34,020::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:34,020::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:34,020::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:34,020::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:34,020::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721243::DEBUG::2014-06-26 17:10:34,021::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:10:34,021::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721243::DEBUG::2014-06-26 17:10:34,022::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:10:34,742::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:10:34,749::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000260801 s, 2.1 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:10:35,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:35,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118043 s, 86.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:37,035::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:37,036::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:37,037::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:37,037::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:37,038::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:37,039::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:37,041::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721244::DEBUG::2014-06-26 17:10:37,041::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721244::DEBUG::2014-06-26 17:10:37,044::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:37,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:37,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121439 s, 84.3 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:10:37,590::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:10:37,597::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000444564 s, 884 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:38,381::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:38,381::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:38,381::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:38,381::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:38,381::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:38,381::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:38,382::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721245::DEBUG::2014-06-26 17:10:38,382::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721245::DEBUG::2014-06-26 17:10:38,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`97f7e90e-83b5-42a2-af5e-538d0e034e78`::moving from state init -> state preparing >Thread-721245::INFO::2014-06-26 17:10:38,383::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721245::INFO::2014-06-26 17:10:38,383::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721245::DEBUG::2014-06-26 17:10:38,383::task::1191::Storage.TaskManager.Task::(prepare) Task=`97f7e90e-83b5-42a2-af5e-538d0e034e78`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721245::DEBUG::2014-06-26 17:10:38,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`97f7e90e-83b5-42a2-af5e-538d0e034e78`::moving from state preparing -> state finished >Thread-721245::DEBUG::2014-06-26 17:10:38,384::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721245::DEBUG::2014-06-26 17:10:38,384::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721245::DEBUG::2014-06-26 17:10:38,384::task::993::Storage.TaskManager.Task::(_decref) Task=`97f7e90e-83b5-42a2-af5e-538d0e034e78`::ref 0 aborting False >Thread-721245::DEBUG::2014-06-26 17:10:38,384::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:38,398::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:38,398::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:38,398::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:38,398::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:38,399::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:38,399::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:38,399::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721246::DEBUG::2014-06-26 17:10:38,399::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721246::DEBUG::2014-06-26 17:10:38,400::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f6aef43-0ad3-4287-aeec-e856da802dd5`::moving from state init -> state preparing >Thread-721246::INFO::2014-06-26 17:10:38,400::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721246::DEBUG::2014-06-26 17:10:38,400::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`26a0a154-930c-4bda-b357-68295a67f378`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721246::DEBUG::2014-06-26 17:10:38,400::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721246::DEBUG::2014-06-26 17:10:38,401::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721246::DEBUG::2014-06-26 17:10:38,401::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`26a0a154-930c-4bda-b357-68295a67f378`::Granted request >Thread-721246::DEBUG::2014-06-26 17:10:38,402::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8f6aef43-0ad3-4287-aeec-e856da802dd5`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721246::DEBUG::2014-06-26 17:10:38,402::task::993::Storage.TaskManager.Task::(_decref) Task=`8f6aef43-0ad3-4287-aeec-e856da802dd5`::ref 1 aborting False >Thread-721246::INFO::2014-06-26 17:10:38,404::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721246::DEBUG::2014-06-26 17:10:38,404::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f6aef43-0ad3-4287-aeec-e856da802dd5`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721246::DEBUG::2014-06-26 17:10:38,404::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f6aef43-0ad3-4287-aeec-e856da802dd5`::moving from state preparing -> state finished >Thread-721246::DEBUG::2014-06-26 17:10:38,404::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721246::DEBUG::2014-06-26 17:10:38,404::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721246::DEBUG::2014-06-26 17:10:38,404::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721246::DEBUG::2014-06-26 17:10:38,404::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721246::DEBUG::2014-06-26 17:10:38,405::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721246::DEBUG::2014-06-26 17:10:38,405::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721246::DEBUG::2014-06-26 17:10:38,405::task::993::Storage.TaskManager.Task::(_decref) Task=`8f6aef43-0ad3-4287-aeec-e856da802dd5`::ref 0 aborting False >Thread-721246::DEBUG::2014-06-26 17:10:38,405::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:39,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:39,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119172 s, 85.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:40,055::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:40,055::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:40,055::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:40,055::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:40,055::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:40,056::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:40,056::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721247::DEBUG::2014-06-26 17:10:40,056::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721247::DEBUG::2014-06-26 17:10:40,058::task::595::Storage.TaskManager.Task::(_updateState) Task=`835821e8-b693-4fb7-875c-6ab3e4b6ab65`::moving from state init -> state preparing >Thread-721247::INFO::2014-06-26 17:10:40,059::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721247::INFO::2014-06-26 17:10:40,063::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000444564', 'lastCheck': '2.5', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000260801', 'lastCheck': '5.3', 'valid': True}} >Thread-721247::DEBUG::2014-06-26 17:10:40,063::task::1191::Storage.TaskManager.Task::(prepare) Task=`835821e8-b693-4fb7-875c-6ab3e4b6ab65`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000444564', 'lastCheck': '2.5', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000260801', 'lastCheck': '5.3', 'valid': True}} >Thread-721247::DEBUG::2014-06-26 17:10:40,063::task::595::Storage.TaskManager.Task::(_updateState) Task=`835821e8-b693-4fb7-875c-6ab3e4b6ab65`::moving from state preparing -> state finished >Thread-721247::DEBUG::2014-06-26 17:10:40,063::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721247::DEBUG::2014-06-26 17:10:40,063::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721247::DEBUG::2014-06-26 17:10:40,063::task::993::Storage.TaskManager.Task::(_decref) Task=`835821e8-b693-4fb7-875c-6ab3e4b6ab65`::ref 0 aborting False >Thread-721247::DEBUG::2014-06-26 17:10:40,066::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:40,098::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:40,098::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:40,098::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:40,099::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:40,099::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:40,099::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:40,099::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721248::DEBUG::2014-06-26 17:10:40,099::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721248::DEBUG::2014-06-26 17:10:40,100::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:41,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:41,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117746 s, 87.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:43,134::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:43,135::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:43,135::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:43,135::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:43,135::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:43,135::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:43,136::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721249::DEBUG::2014-06-26 17:10:43,136::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721249::DEBUG::2014-06-26 17:10:43,137::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:43,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:43,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118884 s, 86.1 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:10:44,751::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:10:44,758::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000331132 s, 1.7 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:10:45,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:45,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117999 s, 86.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:46,149::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:46,149::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:46,149::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:46,149::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:46,149::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:46,150::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:46,150::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721250::DEBUG::2014-06-26 17:10:46,150::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721250::DEBUG::2014-06-26 17:10:46,151::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:10:47,599::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:10:47,606::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000629793 s, 624 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:10:47,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:47,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120114 s, 85.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:48,436::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:48,436::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:48,437::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:48,437::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:48,437::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:48,437::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721251::DEBUG::2014-06-26 17:10:48,438::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:10:48,438::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721251::DEBUG::2014-06-26 17:10:48,439::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6e70385-3464-433c-9284-fb198b681cdd`::moving from state init -> state preparing >Thread-721251::INFO::2014-06-26 17:10:48,439::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721251::INFO::2014-06-26 17:10:48,439::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721251::DEBUG::2014-06-26 17:10:48,439::task::1191::Storage.TaskManager.Task::(prepare) Task=`a6e70385-3464-433c-9284-fb198b681cdd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721251::DEBUG::2014-06-26 17:10:48,439::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6e70385-3464-433c-9284-fb198b681cdd`::moving from state preparing -> state finished >Thread-721251::DEBUG::2014-06-26 17:10:48,440::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721251::DEBUG::2014-06-26 17:10:48,440::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721251::DEBUG::2014-06-26 17:10:48,440::task::993::Storage.TaskManager.Task::(_decref) Task=`a6e70385-3464-433c-9284-fb198b681cdd`::ref 0 aborting False >Thread-721251::DEBUG::2014-06-26 17:10:48,440::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:48,455::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:48,456::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:48,456::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:48,456::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:48,456::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:48,456::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:48,456::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721252::DEBUG::2014-06-26 17:10:48,456::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721252::DEBUG::2014-06-26 17:10:48,457::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a372127-eaa6-442d-a0c7-0f2eb01ce130`::moving from state init -> state preparing >Thread-721252::INFO::2014-06-26 17:10:48,457::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721252::DEBUG::2014-06-26 17:10:48,458::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`b0ad5a9a-fe3d-428d-b546-05a351dc5607`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721252::DEBUG::2014-06-26 17:10:48,458::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721252::DEBUG::2014-06-26 17:10:48,458::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721252::DEBUG::2014-06-26 17:10:48,458::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`b0ad5a9a-fe3d-428d-b546-05a351dc5607`::Granted request >Thread-721252::DEBUG::2014-06-26 17:10:48,458::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0a372127-eaa6-442d-a0c7-0f2eb01ce130`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721252::DEBUG::2014-06-26 17:10:48,458::task::993::Storage.TaskManager.Task::(_decref) Task=`0a372127-eaa6-442d-a0c7-0f2eb01ce130`::ref 1 aborting False >Thread-721252::INFO::2014-06-26 17:10:48,461::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721252::DEBUG::2014-06-26 17:10:48,461::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a372127-eaa6-442d-a0c7-0f2eb01ce130`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721252::DEBUG::2014-06-26 17:10:48,461::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a372127-eaa6-442d-a0c7-0f2eb01ce130`::moving from state preparing -> state finished >Thread-721252::DEBUG::2014-06-26 17:10:48,461::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721252::DEBUG::2014-06-26 17:10:48,461::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721252::DEBUG::2014-06-26 17:10:48,461::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721252::DEBUG::2014-06-26 17:10:48,461::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721252::DEBUG::2014-06-26 17:10:48,461::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721252::DEBUG::2014-06-26 17:10:48,461::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721252::DEBUG::2014-06-26 17:10:48,461::task::993::Storage.TaskManager.Task::(_decref) Task=`0a372127-eaa6-442d-a0c7-0f2eb01ce130`::ref 0 aborting False >Thread-721252::DEBUG::2014-06-26 17:10:48,462::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:49,162::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:49,162::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:49,162::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:49,162::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:49,162::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:49,163::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721253::DEBUG::2014-06-26 17:10:49,163::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:10:49,163::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721253::DEBUG::2014-06-26 17:10:49,164::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:49,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:49,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120679 s, 84.9 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:10:51,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:51,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011996 s, 85.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:52,175::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:52,176::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:52,176::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:52,176::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:52,176::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:52,176::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:52,177::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721254::DEBUG::2014-06-26 17:10:52,177::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721254::DEBUG::2014-06-26 17:10:52,178::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:53,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:53,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01203 s, 85.1 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:10:54,761::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:10:54,767::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000282419 s, 2.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:55,190::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:55,190::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:55,190::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:55,190::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:55,191::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:55,191::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:55,191::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721255::DEBUG::2014-06-26 17:10:55,191::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721255::DEBUG::2014-06-26 17:10:55,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed42d3cb-0edb-4f2f-8033-9110386aa5ab`::moving from state init -> state preparing >Thread-721255::INFO::2014-06-26 17:10:55,193::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721255::INFO::2014-06-26 17:10:55,193::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000629793', 'lastCheck': '7.6', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000282419', 'lastCheck': '0.4', 'valid': True}} >Thread-721255::DEBUG::2014-06-26 17:10:55,193::task::1191::Storage.TaskManager.Task::(prepare) Task=`ed42d3cb-0edb-4f2f-8033-9110386aa5ab`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000629793', 'lastCheck': '7.6', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000282419', 'lastCheck': '0.4', 'valid': True}} >Thread-721255::DEBUG::2014-06-26 17:10:55,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed42d3cb-0edb-4f2f-8033-9110386aa5ab`::moving from state preparing -> state finished >Thread-721255::DEBUG::2014-06-26 17:10:55,193::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721255::DEBUG::2014-06-26 17:10:55,194::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721255::DEBUG::2014-06-26 17:10:55,194::task::993::Storage.TaskManager.Task::(_decref) Task=`ed42d3cb-0edb-4f2f-8033-9110386aa5ab`::ref 0 aborting False >Thread-721255::DEBUG::2014-06-26 17:10:55,196::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:55,231::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:55,232::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:55,232::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:55,232::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:55,232::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:55,232::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:55,232::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721256::DEBUG::2014-06-26 17:10:55,232::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721256::DEBUG::2014-06-26 17:10:55,233::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:10:55,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:55,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117766 s, 87.0 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:10:57,609::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:10:57,616::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000474309 s, 829 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:10:57,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:10:58,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118 s, 86.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:58,266::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:58,266::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:58,266::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:58,266::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:58,266::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:58,266::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:58,267::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721257::DEBUG::2014-06-26 17:10:58,267::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721257::DEBUG::2014-06-26 17:10:58,268::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:58,487::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:58,487::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:58,487::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:58,487::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:58,488::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:58,488::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:58,488::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721258::DEBUG::2014-06-26 17:10:58,488::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721258::DEBUG::2014-06-26 17:10:58,489::task::595::Storage.TaskManager.Task::(_updateState) Task=`7aa4d2a6-c7eb-4201-9279-5e91323df714`::moving from state init -> state preparing >Thread-721258::INFO::2014-06-26 17:10:58,489::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721258::INFO::2014-06-26 17:10:58,490::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721258::DEBUG::2014-06-26 17:10:58,490::task::1191::Storage.TaskManager.Task::(prepare) Task=`7aa4d2a6-c7eb-4201-9279-5e91323df714`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721258::DEBUG::2014-06-26 17:10:58,490::task::595::Storage.TaskManager.Task::(_updateState) Task=`7aa4d2a6-c7eb-4201-9279-5e91323df714`::moving from state preparing -> state finished >Thread-721258::DEBUG::2014-06-26 17:10:58,490::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721258::DEBUG::2014-06-26 17:10:58,490::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721258::DEBUG::2014-06-26 17:10:58,490::task::993::Storage.TaskManager.Task::(_decref) Task=`7aa4d2a6-c7eb-4201-9279-5e91323df714`::ref 0 aborting False >Thread-721258::DEBUG::2014-06-26 17:10:58,490::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:58,506::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:58,506::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:58,506::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:10:58,506::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:10:58,506::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:10:58,506::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:10:58,507::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721259::DEBUG::2014-06-26 17:10:58,507::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721259::DEBUG::2014-06-26 17:10:58,507::task::595::Storage.TaskManager.Task::(_updateState) Task=`d51fb29c-2ea3-42c1-99bc-7958e0f0a6a5`::moving from state init -> state preparing >Thread-721259::INFO::2014-06-26 17:10:58,507::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721259::DEBUG::2014-06-26 17:10:58,508::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`9ae24722-219d-49ca-91a3-b22ddb397a80`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721259::DEBUG::2014-06-26 17:10:58,508::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721259::DEBUG::2014-06-26 17:10:58,508::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721259::DEBUG::2014-06-26 17:10:58,508::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`9ae24722-219d-49ca-91a3-b22ddb397a80`::Granted request >Thread-721259::DEBUG::2014-06-26 17:10:58,508::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d51fb29c-2ea3-42c1-99bc-7958e0f0a6a5`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721259::DEBUG::2014-06-26 17:10:58,509::task::993::Storage.TaskManager.Task::(_decref) Task=`d51fb29c-2ea3-42c1-99bc-7958e0f0a6a5`::ref 1 aborting False >Thread-721259::INFO::2014-06-26 17:10:58,511::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721259::DEBUG::2014-06-26 17:10:58,511::task::1191::Storage.TaskManager.Task::(prepare) Task=`d51fb29c-2ea3-42c1-99bc-7958e0f0a6a5`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721259::DEBUG::2014-06-26 17:10:58,511::task::595::Storage.TaskManager.Task::(_updateState) Task=`d51fb29c-2ea3-42c1-99bc-7958e0f0a6a5`::moving from state preparing -> state finished >Thread-721259::DEBUG::2014-06-26 17:10:58,511::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721259::DEBUG::2014-06-26 17:10:58,511::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721259::DEBUG::2014-06-26 17:10:58,511::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721259::DEBUG::2014-06-26 17:10:58,512::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721259::DEBUG::2014-06-26 17:10:58,512::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721259::DEBUG::2014-06-26 17:10:58,512::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721259::DEBUG::2014-06-26 17:10:58,512::task::993::Storage.TaskManager.Task::(_decref) Task=`d51fb29c-2ea3-42c1-99bc-7958e0f0a6a5`::ref 0 aborting False >Thread-721259::DEBUG::2014-06-26 17:10:58,512::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:11:00,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:00,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115233 s, 88.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:01,279::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:01,279::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:01,280::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:01,280::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:01,280::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:01,280::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:01,281::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721260::DEBUG::2014-06-26 17:11:01,281::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721260::DEBUG::2014-06-26 17:11:01,282::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:11:02,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:02,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119507 s, 85.7 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:11:04,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:04,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124528 s, 82.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:04,293::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:04,293::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:04,293::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:04,293::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:04,294::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:04,294::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:04,294::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721261::DEBUG::2014-06-26 17:11:04,294::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721261::DEBUG::2014-06-26 17:11:04,296::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:11:04,769::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 79aa2072-3ab5-4887-865c-dbb4b6467849 >Thread-160::DEBUG::2014-06-26 17:11:04,775::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849 >Thread-160::DEBUG::2014-06-26 17:11:04,776::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-160::DEBUG::2014-06-26 17:11:04,777::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=master', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=34', 'POOL_DOMAINS=9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=00161ead-084f-42e0-bbdf-6be74f182a50', 'REMOTE_PATH=10.34.63.202:/mnt/export/nfs/lv3/pbenas/35', 'ROLE=Master', 'SDUUID=79aa2072-3ab5-4887-865c-dbb4b6467849', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=b52410f15cd0b1978afafaf4ca1d215a2d5da3ce'] >Thread-160::DEBUG::2014-06-26 17:11:04,778::fileSD::619::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-160::INFO::2014-06-26 17:11:04,778::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 79aa2072-3ab5-4887-865c-dbb4b6467849_imageNS already registered >Thread-160::INFO::2014-06-26 17:11:04,778::sd::391::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 79aa2072-3ab5-4887-865c-dbb4b6467849_volumeNS already registered >Thread-160::DEBUG::2014-06-26 17:11:04,779::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:11:04,786::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000226973 s, 2.5 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:11:06,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:06,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117959 s, 86.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:07,307::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:07,308::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:07,308::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:07,309::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:07,309::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:07,310::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:07,311::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721266::DEBUG::2014-06-26 17:11:07,311::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721266::DEBUG::2014-06-26 17:11:07,316::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:11:07,618::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:11:07,628::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000419343 s, 937 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:11:08,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:08,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119966 s, 85.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:08,537::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:08,538::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:08,539::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:08,539::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:08,539::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:08,539::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:08,540::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721267::DEBUG::2014-06-26 17:11:08,540::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721267::DEBUG::2014-06-26 17:11:08,541::task::595::Storage.TaskManager.Task::(_updateState) Task=`86ab3306-b8f4-40ec-b3b6-b65991fbaebf`::moving from state init -> state preparing >Thread-721267::INFO::2014-06-26 17:11:08,541::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721267::INFO::2014-06-26 17:11:08,541::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721267::DEBUG::2014-06-26 17:11:08,541::task::1191::Storage.TaskManager.Task::(prepare) Task=`86ab3306-b8f4-40ec-b3b6-b65991fbaebf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721267::DEBUG::2014-06-26 17:11:08,541::task::595::Storage.TaskManager.Task::(_updateState) Task=`86ab3306-b8f4-40ec-b3b6-b65991fbaebf`::moving from state preparing -> state finished >Thread-721267::DEBUG::2014-06-26 17:11:08,541::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721267::DEBUG::2014-06-26 17:11:08,542::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721267::DEBUG::2014-06-26 17:11:08,542::task::993::Storage.TaskManager.Task::(_decref) Task=`86ab3306-b8f4-40ec-b3b6-b65991fbaebf`::ref 0 aborting False >Thread-721267::DEBUG::2014-06-26 17:11:08,542::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:08,555::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:08,555::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:08,556::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:08,556::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:08,556::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:08,556::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:08,556::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721268::DEBUG::2014-06-26 17:11:08,556::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721268::DEBUG::2014-06-26 17:11:08,557::task::595::Storage.TaskManager.Task::(_updateState) Task=`845bb6b4-feb4-4e88-a215-48564c96546e`::moving from state init -> state preparing >Thread-721268::INFO::2014-06-26 17:11:08,557::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721268::DEBUG::2014-06-26 17:11:08,557::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`599a85c1-fa48-479d-9004-c7d1ee931384`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721268::DEBUG::2014-06-26 17:11:08,558::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721268::DEBUG::2014-06-26 17:11:08,558::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721268::DEBUG::2014-06-26 17:11:08,558::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`599a85c1-fa48-479d-9004-c7d1ee931384`::Granted request >Thread-721268::DEBUG::2014-06-26 17:11:08,558::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`845bb6b4-feb4-4e88-a215-48564c96546e`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721268::DEBUG::2014-06-26 17:11:08,558::task::993::Storage.TaskManager.Task::(_decref) Task=`845bb6b4-feb4-4e88-a215-48564c96546e`::ref 1 aborting False >Thread-721268::INFO::2014-06-26 17:11:08,560::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721268::DEBUG::2014-06-26 17:11:08,560::task::1191::Storage.TaskManager.Task::(prepare) Task=`845bb6b4-feb4-4e88-a215-48564c96546e`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721268::DEBUG::2014-06-26 17:11:08,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`845bb6b4-feb4-4e88-a215-48564c96546e`::moving from state preparing -> state finished >Thread-721268::DEBUG::2014-06-26 17:11:08,561::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721268::DEBUG::2014-06-26 17:11:08,561::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721268::DEBUG::2014-06-26 17:11:08,561::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721268::DEBUG::2014-06-26 17:11:08,561::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721268::DEBUG::2014-06-26 17:11:08,561::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721268::DEBUG::2014-06-26 17:11:08,561::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721268::DEBUG::2014-06-26 17:11:08,561::task::993::Storage.TaskManager.Task::(_decref) Task=`845bb6b4-feb4-4e88-a215-48564c96546e`::ref 0 aborting False >Thread-721268::DEBUG::2014-06-26 17:11:08,562::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:11:10,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:10,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120237 s, 85.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:10,334::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:10,335::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:10,335::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:10,336::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:10,336::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:10,337::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721269::DEBUG::2014-06-26 17:11:10,339::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:11:10,339::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721269::DEBUG::2014-06-26 17:11:10,343::task::595::Storage.TaskManager.Task::(_updateState) Task=`f68230e1-08be-4fd3-bf9e-7568ea6b4a61`::moving from state init -> state preparing >Thread-721269::INFO::2014-06-26 17:11:10,344::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721269::INFO::2014-06-26 17:11:10,344::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000419343', 'lastCheck': '2.7', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000226973', 'lastCheck': '5.6', 'valid': True}} >Thread-721269::DEBUG::2014-06-26 17:11:10,345::task::1191::Storage.TaskManager.Task::(prepare) Task=`f68230e1-08be-4fd3-bf9e-7568ea6b4a61`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000419343', 'lastCheck': '2.7', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000226973', 'lastCheck': '5.6', 'valid': True}} >Thread-721269::DEBUG::2014-06-26 17:11:10,345::task::595::Storage.TaskManager.Task::(_updateState) Task=`f68230e1-08be-4fd3-bf9e-7568ea6b4a61`::moving from state preparing -> state finished >Thread-721269::DEBUG::2014-06-26 17:11:10,345::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721269::DEBUG::2014-06-26 17:11:10,346::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721269::DEBUG::2014-06-26 17:11:10,346::task::993::Storage.TaskManager.Task::(_decref) Task=`f68230e1-08be-4fd3-bf9e-7568ea6b4a61`::ref 0 aborting False >Thread-721269::DEBUG::2014-06-26 17:11:10,358::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:10,390::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:10,390::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:10,390::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:10,391::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:10,391::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:10,391::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721270::DEBUG::2014-06-26 17:11:10,391::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:11:10,391::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721270::DEBUG::2014-06-26 17:11:10,392::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:11:12,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:12,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119434 s, 85.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:13,438::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:13,438::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:13,438::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:13,438::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:13,439::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:13,439::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:13,439::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721271::DEBUG::2014-06-26 17:11:13,439::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721271::DEBUG::2014-06-26 17:11:13,440::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:11:14,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:14,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118965 s, 86.1 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:11:14,788::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:11:14,795::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.00025265 s, 2.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:16,452::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:16,452::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:16,452::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:16,452::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:16,452::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:16,453::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:16,453::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721272::DEBUG::2014-06-26 17:11:16,453::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721272::DEBUG::2014-06-26 17:11:16,454::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:11:16,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:16,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120632 s, 84.9 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:11:17,630::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:11:17,637::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000474466 s, 828 kB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:11:18,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:18,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120274 s, 85.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:18,587::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:18,587::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:18,587::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:18,587::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:18,587::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:18,587::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:18,588::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721273::DEBUG::2014-06-26 17:11:18,588::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721273::DEBUG::2014-06-26 17:11:18,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc32880b-5e6f-48e1-9410-bf7e3307e8c7`::moving from state init -> state preparing >Thread-721273::INFO::2014-06-26 17:11:18,589::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721273::INFO::2014-06-26 17:11:18,589::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721273::DEBUG::2014-06-26 17:11:18,589::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc32880b-5e6f-48e1-9410-bf7e3307e8c7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721273::DEBUG::2014-06-26 17:11:18,590::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc32880b-5e6f-48e1-9410-bf7e3307e8c7`::moving from state preparing -> state finished >Thread-721273::DEBUG::2014-06-26 17:11:18,590::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721273::DEBUG::2014-06-26 17:11:18,590::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721273::DEBUG::2014-06-26 17:11:18,590::task::993::Storage.TaskManager.Task::(_decref) Task=`cc32880b-5e6f-48e1-9410-bf7e3307e8c7`::ref 0 aborting False >Thread-721273::DEBUG::2014-06-26 17:11:18,590::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:18,605::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:18,605::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:18,605::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:18,605::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:18,605::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:18,606::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:18,606::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721274::DEBUG::2014-06-26 17:11:18,606::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721274::DEBUG::2014-06-26 17:11:18,607::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae6c53d7-8cc4-4121-8814-6b6816e2fb95`::moving from state init -> state preparing >Thread-721274::INFO::2014-06-26 17:11:18,607::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721274::DEBUG::2014-06-26 17:11:18,607::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`7bc48c10-8c90-4c04-b648-ba28ef5af6b2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721274::DEBUG::2014-06-26 17:11:18,607::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721274::DEBUG::2014-06-26 17:11:18,607::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721274::DEBUG::2014-06-26 17:11:18,607::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`7bc48c10-8c90-4c04-b648-ba28ef5af6b2`::Granted request >Thread-721274::DEBUG::2014-06-26 17:11:18,608::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ae6c53d7-8cc4-4121-8814-6b6816e2fb95`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721274::DEBUG::2014-06-26 17:11:18,608::task::993::Storage.TaskManager.Task::(_decref) Task=`ae6c53d7-8cc4-4121-8814-6b6816e2fb95`::ref 1 aborting False >Thread-721274::INFO::2014-06-26 17:11:18,610::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721274::DEBUG::2014-06-26 17:11:18,610::task::1191::Storage.TaskManager.Task::(prepare) Task=`ae6c53d7-8cc4-4121-8814-6b6816e2fb95`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721274::DEBUG::2014-06-26 17:11:18,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae6c53d7-8cc4-4121-8814-6b6816e2fb95`::moving from state preparing -> state finished >Thread-721274::DEBUG::2014-06-26 17:11:18,610::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721274::DEBUG::2014-06-26 17:11:18,610::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721274::DEBUG::2014-06-26 17:11:18,611::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721274::DEBUG::2014-06-26 17:11:18,611::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721274::DEBUG::2014-06-26 17:11:18,611::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721274::DEBUG::2014-06-26 17:11:18,611::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721274::DEBUG::2014-06-26 17:11:18,611::task::993::Storage.TaskManager.Task::(_decref) Task=`ae6c53d7-8cc4-4121-8814-6b6816e2fb95`::ref 0 aborting False >Thread-721274::DEBUG::2014-06-26 17:11:18,611::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:19,464::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:19,464::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:19,464::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:19,465::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:19,465::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:19,465::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:19,465::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721275::DEBUG::2014-06-26 17:11:19,465::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721275::DEBUG::2014-06-26 17:11:19,466::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:11:20,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:20,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119942 s, 85.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:22,479::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:22,479::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:22,479::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:22,479::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:22,480::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:22,480::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:22,480::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721276::DEBUG::2014-06-26 17:11:22,480::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721276::DEBUG::2014-06-26 17:11:22,481::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:11:22,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:22,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117554 s, 87.1 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:11:24,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:24,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011776 s, 87.0 MB/s\n'; <rc> = 0 >Thread-160::DEBUG::2014-06-26 17:11:24,798::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:11:24,805::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000249049 s, 2.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:25,492::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:25,492::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:25,492::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:25,492::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:25,493::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:25,493::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:25,493::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721277::DEBUG::2014-06-26 17:11:25,493::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >Thread-721277::DEBUG::2014-06-26 17:11:25,495::task::595::Storage.TaskManager.Task::(_updateState) Task=`848105dd-d856-4959-bbcb-529fbab21fd6`::moving from state init -> state preparing >Thread-721277::INFO::2014-06-26 17:11:25,495::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721277::INFO::2014-06-26 17:11:25,495::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000474466', 'lastCheck': '7.9', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000249049', 'lastCheck': '0.7', 'valid': True}} >Thread-721277::DEBUG::2014-06-26 17:11:25,495::task::1191::Storage.TaskManager.Task::(prepare) Task=`848105dd-d856-4959-bbcb-529fbab21fd6`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000474466', 'lastCheck': '7.9', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000249049', 'lastCheck': '0.7', 'valid': True}} >Thread-721277::DEBUG::2014-06-26 17:11:25,495::task::595::Storage.TaskManager.Task::(_updateState) Task=`848105dd-d856-4959-bbcb-529fbab21fd6`::moving from state preparing -> state finished >Thread-721277::DEBUG::2014-06-26 17:11:25,495::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721277::DEBUG::2014-06-26 17:11:25,495::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721277::DEBUG::2014-06-26 17:11:25,496::task::993::Storage.TaskManager.Task::(_decref) Task=`848105dd-d856-4959-bbcb-529fbab21fd6`::ref 0 aborting False >Thread-721277::DEBUG::2014-06-26 17:11:25,497::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:25,534::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:25,535::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:25,535::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:25,535::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:25,535::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:25,535::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:25,536::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721278::DEBUG::2014-06-26 17:11:25,536::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721278::DEBUG::2014-06-26 17:11:25,536::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:11:26,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:26,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117463 s, 87.2 MB/s\n'; <rc> = 0 >Thread-123053::DEBUG::2014-06-26 17:11:27,640::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:11:27,648::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000567989 s, 692 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:28,569::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:28,569::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:28,569::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:28,569::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:28,569::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:28,570::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:28,570::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721279::DEBUG::2014-06-26 17:11:28,570::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721279::DEBUG::2014-06-26 17:11:28,571::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:28,636::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:28,636::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:28,636::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:28,636::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:28,636::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:28,636::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:28,637::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721280::DEBUG::2014-06-26 17:11:28,637::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721280::DEBUG::2014-06-26 17:11:28,637::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1a74844-e92d-4949-9ef2-a9c1c25385b0`::moving from state init -> state preparing >Thread-721280::INFO::2014-06-26 17:11:28,638::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721280::INFO::2014-06-26 17:11:28,638::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721280::DEBUG::2014-06-26 17:11:28,638::task::1191::Storage.TaskManager.Task::(prepare) Task=`f1a74844-e92d-4949-9ef2-a9c1c25385b0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721280::DEBUG::2014-06-26 17:11:28,638::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1a74844-e92d-4949-9ef2-a9c1c25385b0`::moving from state preparing -> state finished >Thread-721280::DEBUG::2014-06-26 17:11:28,638::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721280::DEBUG::2014-06-26 17:11:28,638::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721280::DEBUG::2014-06-26 17:11:28,638::task::993::Storage.TaskManager.Task::(_decref) Task=`f1a74844-e92d-4949-9ef2-a9c1c25385b0`::ref 0 aborting False >Thread-721280::DEBUG::2014-06-26 17:11:28,638::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:28,651::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:28,652::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:28,652::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:28,652::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:28,652::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:28,652::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:28,653::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721281::DEBUG::2014-06-26 17:11:28,653::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721281::DEBUG::2014-06-26 17:11:28,653::task::595::Storage.TaskManager.Task::(_updateState) Task=`d050cb0d-bb9d-48bd-9159-bd3f70eae030`::moving from state init -> state preparing >Thread-721281::INFO::2014-06-26 17:11:28,653::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721281::DEBUG::2014-06-26 17:11:28,654::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`ddf3db9f-3a78-435a-9ff9-fb0c341c52a2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721281::DEBUG::2014-06-26 17:11:28,654::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721281::DEBUG::2014-06-26 17:11:28,654::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721281::DEBUG::2014-06-26 17:11:28,654::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`ddf3db9f-3a78-435a-9ff9-fb0c341c52a2`::Granted request >Thread-721281::DEBUG::2014-06-26 17:11:28,654::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d050cb0d-bb9d-48bd-9159-bd3f70eae030`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721281::DEBUG::2014-06-26 17:11:28,654::task::993::Storage.TaskManager.Task::(_decref) Task=`d050cb0d-bb9d-48bd-9159-bd3f70eae030`::ref 1 aborting False >Thread-721281::INFO::2014-06-26 17:11:28,656::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721281::DEBUG::2014-06-26 17:11:28,657::task::1191::Storage.TaskManager.Task::(prepare) Task=`d050cb0d-bb9d-48bd-9159-bd3f70eae030`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721281::DEBUG::2014-06-26 17:11:28,657::task::595::Storage.TaskManager.Task::(_updateState) Task=`d050cb0d-bb9d-48bd-9159-bd3f70eae030`::moving from state preparing -> state finished >Thread-721281::DEBUG::2014-06-26 17:11:28,657::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721281::DEBUG::2014-06-26 17:11:28,657::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721281::DEBUG::2014-06-26 17:11:28,657::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721281::DEBUG::2014-06-26 17:11:28,657::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721281::DEBUG::2014-06-26 17:11:28,657::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721281::DEBUG::2014-06-26 17:11:28,657::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721281::DEBUG::2014-06-26 17:11:28,657::task::993::Storage.TaskManager.Task::(_decref) Task=`d050cb0d-bb9d-48bd-9159-bd3f70eae030`::ref 0 aborting False >Thread-721281::DEBUG::2014-06-26 17:11:28,658::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:11:28,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:28,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119123 s, 86.0 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:11:30,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:30,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116463 s, 87.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:31,581::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:31,581::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:31,581::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:31,581::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:31,582::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:31,582::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:31,582::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721282::DEBUG::2014-06-26 17:11:31,583::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721282::DEBUG::2014-06-26 17:11:31,583::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:11:32,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:32,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117255 s, 87.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:34,593::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:34,594::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:34,594::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:34,594::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:34,594::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:34,594::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721283::DEBUG::2014-06-26 17:11:34,595::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:11:34,595::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721283::DEBUG::2014-06-26 17:11:34,596::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:11:34,808::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:11:34,814::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000235124 s, 2.4 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:11:34,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:34,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116656 s, 87.8 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:11:36,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:37,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178568 s, 57.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:37,605::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:37,605::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:37,605::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:37,605::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:37,606::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:37,606::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:37,606::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721284::DEBUG::2014-06-26 17:11:37,607::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721284::DEBUG::2014-06-26 17:11:37,608::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-123053::DEBUG::2014-06-26 17:11:37,649::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767 >Thread-123053::DEBUG::2014-06-26 17:11:37,656::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767 >Thread-123053::DEBUG::2014-06-26 17:11:37,657::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-123053::DEBUG::2014-06-26 17:11:37,659::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISO_DOMAIN', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00161ead-084f-42e0-bbdf-6be74f182a50', 'REMOTE_PATH=pb-rh35.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140616114208', 'ROLE=Regular', 'SDUUID=9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=32a5a6165ec7c85578dcde10da95cc8a94201d29'] >Thread-123053::DEBUG::2014-06-26 17:11:37,660::fileSD::619::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-123053::INFO::2014-06-26 17:11:37,660::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767_imageNS already registered >Thread-123053::INFO::2014-06-26 17:11:37,660::sd::391::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767_volumeNS already registered >Thread-123053::DEBUG::2014-06-26 17:11:37,661::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-123053::DEBUG::2014-06-26 17:11:37,668::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n393 bytes (393 B) copied, 0.000474444 s, 828 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:38,681::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:38,682::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:38,682::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:38,682::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:38,682::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:38,682::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:38,683::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721289::DEBUG::2014-06-26 17:11:38,683::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getSpmStatus' in bridge >Thread-721289::DEBUG::2014-06-26 17:11:38,684::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6c896f1-9252-4a63-96a0-4b2326ebbb18`::moving from state init -> state preparing >Thread-721289::INFO::2014-06-26 17:11:38,684::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721289::INFO::2014-06-26 17:11:38,684::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721289::DEBUG::2014-06-26 17:11:38,684::task::1191::Storage.TaskManager.Task::(prepare) Task=`e6c896f1-9252-4a63-96a0-4b2326ebbb18`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-721289::DEBUG::2014-06-26 17:11:38,684::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6c896f1-9252-4a63-96a0-4b2326ebbb18`::moving from state preparing -> state finished >Thread-721289::DEBUG::2014-06-26 17:11:38,684::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721289::DEBUG::2014-06-26 17:11:38,685::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721289::DEBUG::2014-06-26 17:11:38,685::task::993::Storage.TaskManager.Task::(_decref) Task=`e6c896f1-9252-4a63-96a0-4b2326ebbb18`::ref 0 aborting False >Thread-721289::DEBUG::2014-06-26 17:11:38,685::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:38,700::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:38,701::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:38,701::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:38,701::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:38,701::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:38,701::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:38,702::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721290::DEBUG::2014-06-26 17:11:38,702::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'StoragePool_getInfo' in bridge >Thread-721290::DEBUG::2014-06-26 17:11:38,702::task::595::Storage.TaskManager.Task::(_updateState) Task=`9571f74a-3eea-4ce6-894a-ca8777b5978d`::moving from state init -> state preparing >Thread-721290::INFO::2014-06-26 17:11:38,702::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'00161ead-084f-42e0-bbdf-6be74f182a50', options=None) >Thread-721290::DEBUG::2014-06-26 17:11:38,703::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`2e33516b-762d-4143-9d86-a0990af9ae9b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2549' at 'getStoragePoolInfo' >Thread-721290::DEBUG::2014-06-26 17:11:38,703::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' for lock type 'shared' >Thread-721290::DEBUG::2014-06-26 17:11:38,703::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free. Now locking as 'shared' (1 active user) >Thread-721290::DEBUG::2014-06-26 17:11:38,703::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00161ead-084f-42e0-bbdf-6be74f182a50`ReqID=`2e33516b-762d-4143-9d86-a0990af9ae9b`::Granted request >Thread-721290::DEBUG::2014-06-26 17:11:38,703::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9571f74a-3eea-4ce6-894a-ca8777b5978d`::_resourcesAcquired: Storage.00161ead-084f-42e0-bbdf-6be74f182a50 (shared) >Thread-721290::DEBUG::2014-06-26 17:11:38,703::task::993::Storage.TaskManager.Task::(_decref) Task=`9571f74a-3eea-4ce6-894a-ca8777b5978d`::ref 1 aborting False >Thread-721290::INFO::2014-06-26 17:11:38,706::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721290::DEBUG::2014-06-26 17:11:38,706::task::1191::Storage.TaskManager.Task::(prepare) Task=`9571f74a-3eea-4ce6-894a-ca8777b5978d`::finished: {'info': {'name': '34', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 0, 'domains': '9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767:Active,131d564c-52d1-4bba-8d60-39e889a8bc08:Attached,79aa2072-3ab5-4887-865c-dbb4b6467849:Active', 'master_uuid': '79aa2072-3ab5-4887-865c-dbb4b6467849', 'version': '0', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'status': 'Active', 'diskfree': '8416919552', 'isoprefix': '/rhev/data-center/mnt/pb-rh35.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140616114208/9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '11712593920', 'version': 0}, '131d564c-52d1-4bba-8d60-39e889a8bc08': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'status': 'Active', 'diskfree': '260971692032', 'isoprefix': '', 'alerts': [], 'disktotal': '422758580224', 'version': 0}}} >Thread-721290::DEBUG::2014-06-26 17:11:38,706::task::595::Storage.TaskManager.Task::(_updateState) Task=`9571f74a-3eea-4ce6-894a-ca8777b5978d`::moving from state preparing -> state finished >Thread-721290::DEBUG::2014-06-26 17:11:38,706::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.00161ead-084f-42e0-bbdf-6be74f182a50': < ResourceRef 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', isValid: 'True' obj: 'None'>} >Thread-721290::DEBUG::2014-06-26 17:11:38,706::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721290::DEBUG::2014-06-26 17:11:38,706::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' >Thread-721290::DEBUG::2014-06-26 17:11:38,706::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' (0 active users) >Thread-721290::DEBUG::2014-06-26 17:11:38,706::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50' is free, finding out if anyone is waiting for it. >Thread-721290::DEBUG::2014-06-26 17:11:38,706::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00161ead-084f-42e0-bbdf-6be74f182a50', Clearing records. >Thread-721290::DEBUG::2014-06-26 17:11:38,706::task::993::Storage.TaskManager.Task::(_decref) Task=`9571f74a-3eea-4ce6-894a-ca8777b5978d`::ref 0 aborting False >Thread-721290::DEBUG::2014-06-26 17:11:38,707::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:11:39,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:39,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115533 s, 88.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:40,617::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:40,618::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:40,618::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:40,618::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:40,618::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:40,618::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >Thread-721291::DEBUG::2014-06-26 17:11:40,619::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getStats' in bridge >JsonRpcServer::DEBUG::2014-06-26 17:11:40,619::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721291::DEBUG::2014-06-26 17:11:40,620::task::595::Storage.TaskManager.Task::(_updateState) Task=`33b3e2f6-0275-43fa-a8c7-477221a9f8c0`::moving from state init -> state preparing >Thread-721291::INFO::2014-06-26 17:11:40,621::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-721291::INFO::2014-06-26 17:11:40,621::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000474444', 'lastCheck': '3.0', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000235124', 'lastCheck': '5.8', 'valid': True}} >Thread-721291::DEBUG::2014-06-26 17:11:40,621::task::1191::Storage.TaskManager.Task::(prepare) Task=`33b3e2f6-0275-43fa-a8c7-477221a9f8c0`::finished: {u'9ccf39ef-ae86-4ba6-8f0b-14ea1dfab767': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000474444', 'lastCheck': '3.0', 'valid': True}, '79aa2072-3ab5-4887-865c-dbb4b6467849': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000235124', 'lastCheck': '5.8', 'valid': True}} >Thread-721291::DEBUG::2014-06-26 17:11:40,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`33b3e2f6-0275-43fa-a8c7-477221a9f8c0`::moving from state preparing -> state finished >Thread-721291::DEBUG::2014-06-26 17:11:40,621::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-721291::DEBUG::2014-06-26 17:11:40,621::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-721291::DEBUG::2014-06-26 17:11:40,621::task::993::Storage.TaskManager.Task::(_decref) Task=`33b3e2f6-0275-43fa-a8c7-477221a9f8c0`::ref 0 aborting False >Thread-721291::DEBUG::2014-06-26 17:11:40,623::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:40,654::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:40,654::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:40,654::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:40,655::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:40,655::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:40,655::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:40,655::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721292::DEBUG::2014-06-26 17:11:40,655::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getAllVmStats' in bridge >Thread-721292::DEBUG::2014-06-26 17:11:40,656::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Dummy-208::DEBUG::2014-06-26 17:11:41,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:41,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116424 s, 88.0 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:11:43,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:43,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116925 s, 87.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:43,692::stompReactor::70::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:43,692::stompReactor::66::Broker.StompAdapter::(_cmd_send) Passing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:43,692::stompReactor::124::yajsonrpc.StompServer::(_handleMessage) Processing incoming message >JsonRpc (StompReactor)::DEBUG::2014-06-26 17:11:43,692::__init__::457::jsonrpc.JsonRpcServer::(queueRequest) Queueing request >JsonRpcServer::DEBUG::2014-06-26 17:11:43,692::__init__::497::jsonrpc.JsonRpcServer::(serve_requests) Popped request >JsonRpcServer::DEBUG::2014-06-26 17:11:43,693::__init__::502::jsonrpc.JsonRpcServer::(serve_requests) Parsing message >JsonRpcServer::DEBUG::2014-06-26 17:11:43,693::__init__::495::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-721293::DEBUG::2014-06-26 17:11:43,693::__init__::463::jsonrpc.JsonRpcServer::(_serveRequest) Looking for method 'Host_getVMList' in bridge >Thread-721293::DEBUG::2014-06-26 17:11:43,694::stompReactor::136::yajsonrpc.StompServer::(send) Sending response >Thread-160::DEBUG::2014-06-26 17:11:44,816::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/rhev/data-center/mnt/10.34.63.202:_mnt_export_nfs_lv3_pbenas_35/79aa2072-3ab5-4887-865c-dbb4b6467849/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-160::DEBUG::2014-06-26 17:11:44,823::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n559 bytes (559 B) copied, 0.000263067 s, 2.1 MB/s\n'; <rc> = 0 >Dummy-208::DEBUG::2014-06-26 17:11:45,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/00161ead-084f-42e0-bbdf-6be74f182a50/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-208::DEBUG::2014-06-26 17:11:45,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0155384 s, 65.9 MB/s\n'; <rc> = 0
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1113670
:
912458
| 912460