Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 917884 Details for
Bug 1116558
Allow qemu-img to bypass the host cache (check, compare, convert, rebase, amend)
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm.log
snashot_delete_vdsm.log (text/plain), 978.62 KB, created by
Markus Stockhausen
on 2014-07-14 14:47:46 UTC
(
hide
)
Description:
vdsm.log
Filename:
MIME Type:
Creator:
Markus Stockhausen
Created:
2014-07-14 14:47:46 UTC
Size:
978.62 KB
patch
obsolete
>Thread-135151::DEBUG::2014-07-14 16:32:37,164::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:32:37,164::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:32:37,164::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:32:37,165::task::1185::TaskManager.Task::(prepare) Task=`5a8c33ac-609a-4834-8bfc-84a5491023de`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:32:37,165::task::595::TaskManager.Task::(_updateState) Task=`5a8c33ac-609a-4834-8bfc-84a5491023de`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:32:37,165::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:32:37,165::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:32:37,165::task::990::TaskManager.Task::(_decref) Task=`5a8c33ac-609a-4834-8bfc-84a5491023de`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:32:38,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:32:38,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371818 s, 27.5 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:32:39,853::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:32:39,862::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000147551 s, 2.4 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:32:40,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:32:40,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374923 s, 27.3 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:32:41,023::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:32:41,032::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00020493 s, 2.7 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:32:42,556::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2c51d320-88ce-4f23-8215-e15f55f66906 >Thread-11633::DEBUG::2014-07-14 16:32:42,562::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906 >Thread-11633::DEBUG::2014-07-14 16:32:42,563::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-11633::DEBUG::2014-07-14 16:32:42,564::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=colnas03_IB', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=Collogia', 'POOL_DOMAINS=272ec473-6041-42ee-bd1a-732789dd18d4:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=8', 'POOL_UUID=94ed7a19-fade-4bd6-83f2-2cbb2f730b95', 'REMOTE_PATH=10.10.30.253:/var/nas3/OVirtIB', 'ROLE=Master', 'SDUUID=2c51d320-88ce-4f23-8215-e15f55f66906', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=7829fcdff1769c5cc605544bf5c48fb68b8d48a6'] >Thread-11633::DEBUG::2014-07-14 16:32:42,566::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-11633::INFO::2014-07-14 16:32:42,566::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2c51d320-88ce-4f23-8215-e15f55f66906_imageNS already registered >Thread-11633::INFO::2014-07-14 16:32:42,566::sd::391::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2c51d320-88ce-4f23-8215-e15f55f66906_volumeNS already registered >Thread-11633::DEBUG::2014-07-14 16:32:42,569::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:32:42,578::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000181141 s, 3.6 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:32:42,642::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.09129309654 thisRx 5730412 thisTx 2913827424 samples [(1405348352.607569, 1384785654022, 1366609898748), (1405348354.622429, 1384787074454, 1367316241912), (1405348356.650316, 1384788519258, 1368058196268), (1405348358.680061, 1384789172418, 1368792726240), (1405348360.698862, 1384791384434, 1369523726172)] >Thread-135151::DEBUG::2014-07-14 16:32:42,643::task::595::TaskManager.Task::(_updateState) Task=`9023d7c5-b0e4-4f19-bc18-61ce03df273e`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:32:42,644::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:32:42,644::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000181141', 'lastCheck': '0.1', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00020493', 'lastCheck': '1.6', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000147551', 'lastCheck': '2.8', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000237992', 'lastCheck': '9.4', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000209568', 'lastCheck': '8.3', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:32:42,644::task::1185::TaskManager.Task::(prepare) Task=`9023d7c5-b0e4-4f19-bc18-61ce03df273e`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000181141', 'lastCheck': '0.1', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00020493', 'lastCheck': '1.6', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000147551', 'lastCheck': '2.8', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000237992', 'lastCheck': '9.4', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000209568', 'lastCheck': '8.3', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:32:42,644::task::595::TaskManager.Task::(_updateState) Task=`9023d7c5-b0e4-4f19-bc18-61ce03df273e`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:32:42,645::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:32:42,645::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:32:42,645::task::990::TaskManager.Task::(_decref) Task=`9023d7c5-b0e4-4f19-bc18-61ce03df273e`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:32:42,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-135151::DEBUG::2014-07-14 16:32:42,853::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:32:42,853::task::595::TaskManager.Task::(_updateState) Task=`b54ab39f-5a42-4adf-964c-8ecd2df3fadf`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:32:42,853::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:32:42,855::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:32:42,856::task::1185::TaskManager.Task::(prepare) Task=`b54ab39f-5a42-4adf-964c-8ecd2df3fadf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:32:42,857::task::595::TaskManager.Task::(_updateState) Task=`b54ab39f-5a42-4adf-964c-8ecd2df3fadf`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:32:42,858::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:32:42,859::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:32:42,860::task::990::TaskManager.Task::(_decref) Task=`b54ab39f-5a42-4adf-964c-8ecd2df3fadf`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:32:42,867::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:32:42,869::task::595::TaskManager.Task::(_updateState) Task=`7b155d1a-0f65-42d5-a2aa-088a7b797f6d`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:32:42,870::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:32:42,873::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`7066ee24-75f2-463a-a87a-88ae4ca99695`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:32:42,874::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:32:42,875::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:32:42,876::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`7066ee24-75f2-463a-a87a-88ae4ca99695`::Granted request >Thread-135152::DEBUG::2014-07-14 16:32:42,878::task::827::TaskManager.Task::(resourceAcquired) Task=`7b155d1a-0f65-42d5-a2aa-088a7b797f6d`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:32:42,880::task::990::TaskManager.Task::(_decref) Task=`7b155d1a-0f65-42d5-a2aa-088a7b797f6d`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:32:42,903::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3362402598912', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:32:42,904::task::1185::TaskManager.Task::(prepare) Task=`7b155d1a-0f65-42d5-a2aa-088a7b797f6d`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3362402598912', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:32:42,906::task::595::TaskManager.Task::(_updateState) Task=`7b155d1a-0f65-42d5-a2aa-088a7b797f6d`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:32:42,907::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:32:42,908::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:32:42,909::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:32:42,911::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:32:42,912::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:32:42,913::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:32:42,915::task::990::TaskManager.Task::(_decref) Task=`7b155d1a-0f65-42d5-a2aa-088a7b797f6d`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:32:42,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.095605 s, 10.7 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:32:43,285::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:32:43,294::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000239156 s, 1.5 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:32:44,372::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:32:44,381::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000222401 s, 2.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:32:44,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:32:45,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273654 s, 37.4 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:32:47,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:32:47,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285198 s, 35.9 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:32:47,172::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:32:47,173::task::595::TaskManager.Task::(_updateState) Task=`d58428b8-b087-4b06-ad7b-8545025805e3`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:32:47,173::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:32:47,173::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:32:47,173::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:32:47,173::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:32:47,174::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:32:47,174::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:32:47,174::task::1185::TaskManager.Task::(prepare) Task=`d58428b8-b087-4b06-ad7b-8545025805e3`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:32:47,174::task::595::TaskManager.Task::(_updateState) Task=`d58428b8-b087-4b06-ad7b-8545025805e3`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:32:47,174::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:32:47,174::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:32:47,175::task::990::TaskManager.Task::(_decref) Task=`d58428b8-b087-4b06-ad7b-8545025805e3`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:32:49,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:32:49,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272457 s, 37.6 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:32:49,867::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:32:49,876::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000186133 s, 1.9 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:32:51,040::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:32:51,049::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000225472 s, 2.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:32:51,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:32:51,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274572 s, 37.3 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:32:52,586::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:32:52,595::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000249974 s, 2.6 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:32:53,153::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:32:53,153::task::595::TaskManager.Task::(_updateState) Task=`7a90fc71-5f6b-4bd4-9b84-29a9ae230f46`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:32:53,154::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:32:53,154::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:32:53,154::task::1185::TaskManager.Task::(prepare) Task=`7a90fc71-5f6b-4bd4-9b84-29a9ae230f46`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:32:53,154::task::595::TaskManager.Task::(_updateState) Task=`7a90fc71-5f6b-4bd4-9b84-29a9ae230f46`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:32:53,154::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:32:53,155::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:32:53,155::task::990::TaskManager.Task::(_decref) Task=`7a90fc71-5f6b-4bd4-9b84-29a9ae230f46`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:32:53,158::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:32:53,158::task::595::TaskManager.Task::(_updateState) Task=`e968cb32-c4a3-4435-aefb-3191c75210d0`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:32:53,159::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:32:53,159::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`a6c2f818-ed04-4953-967c-15eb5eee9237`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:32:53,159::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:32:53,160::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:32:53,161::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`a6c2f818-ed04-4953-967c-15eb5eee9237`::Granted request >Thread-135152::DEBUG::2014-07-14 16:32:53,161::task::827::TaskManager.Task::(resourceAcquired) Task=`e968cb32-c4a3-4435-aefb-3191c75210d0`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:32:53,161::task::990::TaskManager.Task::(_decref) Task=`e968cb32-c4a3-4435-aefb-3191c75210d0`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:32:53,165::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3358921326592', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:32:53,165::task::1185::TaskManager.Task::(prepare) Task=`e968cb32-c4a3-4435-aefb-3191c75210d0`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3358921326592', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:32:53,165::task::595::TaskManager.Task::(_updateState) Task=`e968cb32-c4a3-4435-aefb-3191c75210d0`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:32:53,165::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:32:53,165::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:32:53,166::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:32:53,166::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:32:53,166::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:32:53,166::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:32:53,166::task::990::TaskManager.Task::(_decref) Task=`e968cb32-c4a3-4435-aefb-3191c75210d0`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:32:53,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:32:53,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.022165 s, 46.2 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:32:53,318::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:32:53,329::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000194703 s, 1.9 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:32:54,387::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:32:54,396::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000270365 s, 2.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:32:55,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:32:55,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279287 s, 36.7 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:32:57,181::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:32:57,182::task::595::TaskManager.Task::(_updateState) Task=`a2cede68-66a6-4692-a07a-3361b6e024fa`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:32:57,182::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:32:57,182::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:32:57,182::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:32:57,182::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:32:57,182::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:32:57,183::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:32:57,183::task::1185::TaskManager.Task::(prepare) Task=`a2cede68-66a6-4692-a07a-3361b6e024fa`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:32:57,183::task::595::TaskManager.Task::(_updateState) Task=`a2cede68-66a6-4692-a07a-3361b6e024fa`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:32:57,183::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:32:57,183::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:32:57,183::task::990::TaskManager.Task::(_decref) Task=`a2cede68-66a6-4692-a07a-3361b6e024fa`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:32:57,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:32:57,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0228661 s, 44.8 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:32:57,823::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.05844593048 thisRx 6746660 thisTx 2823210944 samples [(1405348368.757707, 1384798107478, 1372392247912), (1405348370.771978, 1384799533298, 1373116903736), (1405348372.786604, 1384802023026, 1373839422692), (1405348374.801401, 1384803433198, 1374485368180), (1405348376.816153, 1384804854138, 1375215458856)] >Thread-135151::DEBUG::2014-07-14 16:32:57,824::task::595::TaskManager.Task::(_updateState) Task=`c432a025-9dbc-43a4-985f-1eac4ff3ec39`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:32:57,824::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:32:57,824::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249974', 'lastCheck': '5.2', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000225472', 'lastCheck': '6.8', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000186133', 'lastCheck': '7.9', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000194703', 'lastCheck': '4.5', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270365', 'lastCheck': '3.4', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:32:57,825::task::1185::TaskManager.Task::(prepare) Task=`c432a025-9dbc-43a4-985f-1eac4ff3ec39`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249974', 'lastCheck': '5.2', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000225472', 'lastCheck': '6.8', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000186133', 'lastCheck': '7.9', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000194703', 'lastCheck': '4.5', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270365', 'lastCheck': '3.4', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:32:57,825::task::595::TaskManager.Task::(_updateState) Task=`c432a025-9dbc-43a4-985f-1eac4ff3ec39`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:32:57,825::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:32:57,825::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:32:57,825::task::990::TaskManager.Task::(_decref) Task=`c432a025-9dbc-43a4-985f-1eac4ff3ec39`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:32:59,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:32:59,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246372 s, 41.6 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:32:59,882::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:32:59,890::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000244995 s, 1.5 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:33:01,057::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:33:01,066::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000211272 s, 2.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:01,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:01,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306026 s, 33.5 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:33:02,602::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:33:02,610::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000260234 s, 2.5 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:33:03,337::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:33:03,346::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000234015 s, 1.6 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:33:03,490::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:33:03,491::task::595::TaskManager.Task::(_updateState) Task=`3b1227e9-5393-43fc-b79f-471fc8e297a9`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:33:03,491::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:33:03,491::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:33:03,492::task::1185::TaskManager.Task::(prepare) Task=`3b1227e9-5393-43fc-b79f-471fc8e297a9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:33:03,492::task::595::TaskManager.Task::(_updateState) Task=`3b1227e9-5393-43fc-b79f-471fc8e297a9`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:33:03,492::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:33:03,492::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:33:03,493::task::990::TaskManager.Task::(_decref) Task=`3b1227e9-5393-43fc-b79f-471fc8e297a9`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:33:03,497::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:33:03,497::task::595::TaskManager.Task::(_updateState) Task=`a04b15a8-b7eb-4346-a7a5-7d5fb4473ac0`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:33:03,498::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:33:03,498::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`229d042c-785c-481b-ae53-5b9b349d03f0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:33:03,499::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:33:03,499::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:33:03,500::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`229d042c-785c-481b-ae53-5b9b349d03f0`::Granted request >Thread-135152::DEBUG::2014-07-14 16:33:03,500::task::827::TaskManager.Task::(resourceAcquired) Task=`a04b15a8-b7eb-4346-a7a5-7d5fb4473ac0`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:33:03,500::task::990::TaskManager.Task::(_decref) Task=`a04b15a8-b7eb-4346-a7a5-7d5fb4473ac0`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:33:03,506::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3355570077696', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:33:03,506::task::1185::TaskManager.Task::(prepare) Task=`a04b15a8-b7eb-4346-a7a5-7d5fb4473ac0`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3355570077696', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:33:03,506::task::595::TaskManager.Task::(_updateState) Task=`a04b15a8-b7eb-4346-a7a5-7d5fb4473ac0`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:33:03,507::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:33:03,507::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:33:03,507::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:33:03,507::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:33:03,507::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:33:03,508::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:33:03,508::task::990::TaskManager.Task::(_decref) Task=`a04b15a8-b7eb-4346-a7a5-7d5fb4473ac0`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:33:03,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:03,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295297 s, 34.7 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:33:04,402::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:33:04,411::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00025539 s, 2.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:05,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:05,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243732 s, 42.0 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:33:07,191::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:33:07,192::task::595::TaskManager.Task::(_updateState) Task=`b6d7bca7-fdeb-48e1-bfc1-a85728d6e7b3`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:33:07,193::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:33:07,193::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:33:07,193::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:33:07,193::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:33:07,193::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:33:07,194::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:33:07,194::task::1185::TaskManager.Task::(prepare) Task=`b6d7bca7-fdeb-48e1-bfc1-a85728d6e7b3`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:33:07,194::task::595::TaskManager.Task::(_updateState) Task=`b6d7bca7-fdeb-48e1-bfc1-a85728d6e7b3`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:33:07,194::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:33:07,194::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:33:07,195::task::990::TaskManager.Task::(_decref) Task=`b6d7bca7-fdeb-48e1-bfc1-a85728d6e7b3`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:33:07,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:07,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307272 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:09,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:09,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0250673 s, 40.9 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:33:09,896::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:33:09,905::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000338115 s, 1.1 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:33:11,075::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:33:11,085::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000257925 s, 2.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:11,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:11,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0255373 s, 40.1 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:33:12,620::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:33:12,628::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000129022 s, 5.0 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:33:12,996::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.05937314034 thisRx 6739624 thisTx 2892223500 samples [(1405348384.878439, 1384812646970, 1378035483556), (1405348386.893599, 1384814056418, 1378751518384), (1405348388.907981, 1384815470110, 1379479434388), (1405348390.923168, 1384816890786, 1380203033716), (1405348392.937812, 1384819386594, 1380927707056)] >Thread-135151::DEBUG::2014-07-14 16:33:12,997::task::595::TaskManager.Task::(_updateState) Task=`61f7ce84-25db-432d-a148-bb0da74b1748`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:33:12,997::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:33:12,998::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000129022', 'lastCheck': '0.4', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000257925', 'lastCheck': '1.9', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000338115', 'lastCheck': '3.1', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000234015', 'lastCheck': '9.7', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025539', 'lastCheck': '8.6', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:33:12,998::task::1185::TaskManager.Task::(prepare) Task=`61f7ce84-25db-432d-a148-bb0da74b1748`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000129022', 'lastCheck': '0.4', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000257925', 'lastCheck': '1.9', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000338115', 'lastCheck': '3.1', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000234015', 'lastCheck': '9.7', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025539', 'lastCheck': '8.6', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:33:12,999::task::595::TaskManager.Task::(_updateState) Task=`61f7ce84-25db-432d-a148-bb0da74b1748`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:33:12,999::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:33:12,999::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:33:12,999::task::990::TaskManager.Task::(_decref) Task=`61f7ce84-25db-432d-a148-bb0da74b1748`::ref 0 aborting False >Thread-11641::DEBUG::2014-07-14 16:33:13,352::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:33:13,360::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000215755 s, 1.7 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:33:13,752::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:33:13,753::task::595::TaskManager.Task::(_updateState) Task=`4a79b2f1-4f80-4855-a817-4c23c2b50c3a`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:33:13,753::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:33:13,753::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:33:13,754::task::1185::TaskManager.Task::(prepare) Task=`4a79b2f1-4f80-4855-a817-4c23c2b50c3a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:33:13,754::task::595::TaskManager.Task::(_updateState) Task=`4a79b2f1-4f80-4855-a817-4c23c2b50c3a`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:33:13,754::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:33:13,754::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:33:13,754::task::990::TaskManager.Task::(_decref) Task=`4a79b2f1-4f80-4855-a817-4c23c2b50c3a`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:33:13,758::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:33:13,759::task::595::TaskManager.Task::(_updateState) Task=`4869451c-850a-4c4f-b4e0-a446a10eceed`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:33:13,759::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:33:13,759::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`e827452f-8acb-4040-a487-7feb9b916a69`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:33:13,760::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:33:13,760::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:33:13,760::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`e827452f-8acb-4040-a487-7feb9b916a69`::Granted request >Thread-135152::DEBUG::2014-07-14 16:33:13,760::task::827::TaskManager.Task::(resourceAcquired) Task=`4869451c-850a-4c4f-b4e0-a446a10eceed`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:33:13,761::task::990::TaskManager.Task::(_decref) Task=`4869451c-850a-4c4f-b4e0-a446a10eceed`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:33:13,764::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3352079368192', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:33:13,764::task::1185::TaskManager.Task::(prepare) Task=`4869451c-850a-4c4f-b4e0-a446a10eceed`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3352079368192', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:33:13,765::task::595::TaskManager.Task::(_updateState) Task=`4869451c-850a-4c4f-b4e0-a446a10eceed`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:33:13,765::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:33:13,765::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:33:13,765::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:33:13,766::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:33:13,766::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:33:13,766::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:33:13,766::task::990::TaskManager.Task::(_decref) Task=`4869451c-850a-4c4f-b4e0-a446a10eceed`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:33:13,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:13,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279404 s, 36.6 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:33:14,416::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:33:14,424::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000190129 s, 2.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:15,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:16,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277252 s, 36.9 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:33:17,203::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:33:17,204::task::595::TaskManager.Task::(_updateState) Task=`e1077a3d-f36a-430d-bf36-6f8e2f0a1300`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:33:17,204::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:33:17,204::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:33:17,204::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:33:17,205::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:33:17,205::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:33:17,205::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:33:17,205::task::1185::TaskManager.Task::(prepare) Task=`e1077a3d-f36a-430d-bf36-6f8e2f0a1300`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:33:17,205::task::595::TaskManager.Task::(_updateState) Task=`e1077a3d-f36a-430d-bf36-6f8e2f0a1300`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:33:17,206::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:33:17,206::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:33:17,206::task::990::TaskManager.Task::(_decref) Task=`e1077a3d-f36a-430d-bf36-6f8e2f0a1300`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:33:18,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:18,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0223254 s, 45.9 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:33:19,910::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:33:19,919::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000243427 s, 1.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:20,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:20,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.140318 s, 7.3 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:33:21,097::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:33:21,107::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.0002828 s, 2.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:22,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:22,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0402573 s, 25.4 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:33:22,636::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:33:22,645::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000299272 s, 2.2 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:33:23,366::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:33:23,374::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000179771 s, 2.0 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:33:24,010::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:33:24,010::task::595::TaskManager.Task::(_updateState) Task=`1ffaf15a-60fa-4de4-ad36-2b46989267cb`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:33:24,011::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:33:24,011::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:33:24,011::task::1185::TaskManager.Task::(prepare) Task=`1ffaf15a-60fa-4de4-ad36-2b46989267cb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:33:24,012::task::595::TaskManager.Task::(_updateState) Task=`1ffaf15a-60fa-4de4-ad36-2b46989267cb`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:33:24,012::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:33:24,012::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:33:24,012::task::990::TaskManager.Task::(_decref) Task=`1ffaf15a-60fa-4de4-ad36-2b46989267cb`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:33:24,016::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:33:24,016::task::595::TaskManager.Task::(_updateState) Task=`e016d36e-9228-4a3f-9a02-2e2e98a66afb`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:33:24,017::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:33:24,017::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`d90c6f0b-197c-4ebd-96cd-d9d72471dbe8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:33:24,018::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:33:24,018::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:33:24,018::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`d90c6f0b-197c-4ebd-96cd-d9d72471dbe8`::Granted request >Thread-135152::DEBUG::2014-07-14 16:33:24,018::task::827::TaskManager.Task::(resourceAcquired) Task=`e016d36e-9228-4a3f-9a02-2e2e98a66afb`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:33:24,019::task::990::TaskManager.Task::(_decref) Task=`e016d36e-9228-4a3f-9a02-2e2e98a66afb`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:33:24,024::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3348524695552', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:33:24,024::task::1185::TaskManager.Task::(prepare) Task=`e016d36e-9228-4a3f-9a02-2e2e98a66afb`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3348524695552', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:33:24,025::task::595::TaskManager.Task::(_updateState) Task=`e016d36e-9228-4a3f-9a02-2e2e98a66afb`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:33:24,025::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:33:24,025::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:33:24,025::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:33:24,025::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:33:24,026::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:33:24,026::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:33:24,026::task::990::TaskManager.Task::(_decref) Task=`e016d36e-9228-4a3f-9a02-2e2e98a66afb`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:33:24,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:33:24,450::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:33:24,463::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000182992 s, 3.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:24,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0769357 s, 13.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:26,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:26,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324049 s, 31.6 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:33:27,212::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:33:27,213::task::595::TaskManager.Task::(_updateState) Task=`f56d2c95-3903-4211-98fb-959fed73eed7`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:33:27,214::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:33:27,214::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:33:27,214::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:33:27,214::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:33:27,214::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:33:27,214::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:33:27,215::task::1185::TaskManager.Task::(prepare) Task=`f56d2c95-3903-4211-98fb-959fed73eed7`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:33:27,215::task::595::TaskManager.Task::(_updateState) Task=`f56d2c95-3903-4211-98fb-959fed73eed7`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:33:27,215::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:33:27,215::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:33:27,215::task::990::TaskManager.Task::(_decref) Task=`f56d2c95-3903-4211-98fb-959fed73eed7`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:33:28,156::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.05998420715 thisRx 7861905 thisTx 2923536388 samples [(1405348398.984537, 1384823645930, 1383126538920), (1405348400.999368, 1384825064526, 1383878170888), (1405348403.014486, 1384828638346, 1384594226996), (1405348405.029296, 1384830070782, 1385324321744), (1405348407.044521, 1384831507835, 1386050075308)] >Thread-135151::DEBUG::2014-07-14 16:33:28,157::task::595::TaskManager.Task::(_updateState) Task=`ddc67cc9-bff4-4878-a172-1a3d3678a23c`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:33:28,158::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:33:28,158::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000299272', 'lastCheck': '5.5', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0002828', 'lastCheck': '7.0', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000243427', 'lastCheck': '8.2', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000179771', 'lastCheck': '4.8', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000182992', 'lastCheck': '3.7', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:33:28,159::task::1185::TaskManager.Task::(prepare) Task=`ddc67cc9-bff4-4878-a172-1a3d3678a23c`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000299272', 'lastCheck': '5.5', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0002828', 'lastCheck': '7.0', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000243427', 'lastCheck': '8.2', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000179771', 'lastCheck': '4.8', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000182992', 'lastCheck': '3.7', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:33:28,159::task::595::TaskManager.Task::(_updateState) Task=`ddc67cc9-bff4-4878-a172-1a3d3678a23c`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:33:28,159::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:33:28,159::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:33:28,159::task::990::TaskManager.Task::(_decref) Task=`ddc67cc9-bff4-4878-a172-1a3d3678a23c`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:33:28,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:28,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370814 s, 27.6 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:33:29,920::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain bff3a2be-fdd9-4e37-b416-fa4ef7fafba2 >Thread-11635::DEBUG::2014-07-14 16:33:29,928::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2 >Thread-11635::DEBUG::2014-07-14 16:33:29,928::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-11635::DEBUG::2014-07-14 16:33:29,930::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=colnas03_ISO', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=94ed7a19-fade-4bd6-83f2-2cbb2f730b95', 'REMOTE_PATH=10.10.30.253:/var/nas3/OVirtISO', 'ROLE=Regular', 'SDUUID=bff3a2be-fdd9-4e37-b416-fa4ef7fafba2', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c50201e21217b2f429ff30bead20d9af06fab3f0'] >Thread-11635::DEBUG::2014-07-14 16:33:29,932::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-11635::INFO::2014-07-14 16:33:29,932::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace bff3a2be-fdd9-4e37-b416-fa4ef7fafba2_imageNS already registered >Thread-11635::INFO::2014-07-14 16:33:29,932::sd::391::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace bff3a2be-fdd9-4e37-b416-fa4ef7fafba2_volumeNS already registered >Thread-11635::DEBUG::2014-07-14 16:33:29,935::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:33:29,943::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000599268 s, 596 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:30,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:30,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390771 s, 26.2 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:33:31,115::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:33:31,124::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000251376 s, 2.2 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:33:32,652::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:33:32,661::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000297718 s, 2.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:32,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:32,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.039173 s, 26.1 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:33:33,380::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:33:33,389::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.00020053 s, 1.8 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:33:34,252::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:33:34,253::task::595::TaskManager.Task::(_updateState) Task=`8070cd2c-1bbf-4bcd-b480-53906de91693`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:33:34,253::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:33:34,254::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:33:34,254::task::1185::TaskManager.Task::(prepare) Task=`8070cd2c-1bbf-4bcd-b480-53906de91693`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:33:34,254::task::595::TaskManager.Task::(_updateState) Task=`8070cd2c-1bbf-4bcd-b480-53906de91693`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:33:34,254::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:33:34,254::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:33:34,255::task::990::TaskManager.Task::(_decref) Task=`8070cd2c-1bbf-4bcd-b480-53906de91693`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:33:34,259::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:33:34,260::task::595::TaskManager.Task::(_updateState) Task=`50a40cb7-b4b0-41c4-963b-ec8adb5f0422`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:33:34,260::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:33:34,261::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`2840cc60-3721-4713-86e6-35a3d79f6a02`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:33:34,261::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:33:34,261::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:33:34,261::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`2840cc60-3721-4713-86e6-35a3d79f6a02`::Granted request >Thread-135152::DEBUG::2014-07-14 16:33:34,262::task::827::TaskManager.Task::(resourceAcquired) Task=`50a40cb7-b4b0-41c4-963b-ec8adb5f0422`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:33:34,262::task::990::TaskManager.Task::(_decref) Task=`50a40cb7-b4b0-41c4-963b-ec8adb5f0422`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:33:34,266::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3345026646016', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:33:34,266::task::1185::TaskManager.Task::(prepare) Task=`50a40cb7-b4b0-41c4-963b-ec8adb5f0422`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3345026646016', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:33:34,267::task::595::TaskManager.Task::(_updateState) Task=`50a40cb7-b4b0-41c4-963b-ec8adb5f0422`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:33:34,267::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:33:34,267::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:33:34,267::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:33:34,268::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:33:34,268::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:33:34,268::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:33:34,269::task::990::TaskManager.Task::(_decref) Task=`50a40cb7-b4b0-41c4-963b-ec8adb5f0422`::ref 0 aborting False >Thread-11647::DEBUG::2014-07-14 16:33:34,472::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:33:34,481::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000243402 s, 2.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:34,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:34,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0409936 s, 25.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:36,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:37,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334182 s, 30.6 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:33:37,220::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [60c00864] >Thread-135151::DEBUG::2014-07-14 16:33:37,220::task::595::TaskManager.Task::(_updateState) Task=`37db106f-8c51-481e-bcde-d9e7dd7f2cb1`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:33:37,221::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:33:37,221::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:33:37,221::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:33:37,221::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:33:37,221::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:33:37,222::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:33:37,222::task::1185::TaskManager.Task::(prepare) Task=`37db106f-8c51-481e-bcde-d9e7dd7f2cb1`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:33:37,222::task::595::TaskManager.Task::(_updateState) Task=`37db106f-8c51-481e-bcde-d9e7dd7f2cb1`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:33:37,222::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:33:37,223::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:33:37,223::task::990::TaskManager.Task::(_decref) Task=`37db106f-8c51-481e-bcde-d9e7dd7f2cb1`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:33:39,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:39,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245841 s, 41.7 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:33:39,949::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:33:39,958::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000226277 s, 1.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:41,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:33:41,154::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:33:41,172::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000143665 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:41,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0843327 s, 12.1 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:33:42,667::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:33:42,675::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000224691 s, 2.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:43,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:43,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307202 s, 33.3 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:33:43,353::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.10019302368 thisRx 6671320 thisTx 2740186944 samples [(1405348415.104208, 1384838273659, 1388925095724), (1405348417.119476, 1384839653639, 1389557020520), (1405348419.134285, 1384841036599, 1390241796388), (1405348421.181239, 1384842443643, 1390961094296), (1405348423.204401, 1384844944979, 1391665282668)] >Thread-135151::DEBUG::2014-07-14 16:33:43,353::task::595::TaskManager.Task::(_updateState) Task=`432f690c-67ab-4f09-bdb4-feda2c6f3896`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:33:43,354::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:33:43,354::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000224691', 'lastCheck': '0.7', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000143665', 'lastCheck': '2.2', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000226277', 'lastCheck': '3.4', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00020053', 'lastCheck': '10.0', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000243402', 'lastCheck': '8.9', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:33:43,354::task::1185::TaskManager.Task::(prepare) Task=`432f690c-67ab-4f09-bdb4-feda2c6f3896`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000224691', 'lastCheck': '0.7', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000143665', 'lastCheck': '2.2', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000226277', 'lastCheck': '3.4', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00020053', 'lastCheck': '10.0', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000243402', 'lastCheck': '8.9', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:33:43,354::task::595::TaskManager.Task::(_updateState) Task=`432f690c-67ab-4f09-bdb4-feda2c6f3896`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:33:43,355::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:33:43,355::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:33:43,355::task::990::TaskManager.Task::(_decref) Task=`432f690c-67ab-4f09-bdb4-feda2c6f3896`::ref 0 aborting False >Thread-11641::DEBUG::2014-07-14 16:33:43,395::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:33:43,404::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000205499 s, 1.8 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:33:44,487::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-135151::DEBUG::2014-07-14 16:33:44,496::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-11647::DEBUG::2014-07-14 16:33:44,498::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000189946 s, 2.9 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:33:44,499::task::595::TaskManager.Task::(_updateState) Task=`da04df12-99ab-46e8-a035-51ed9eb4efc5`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:33:44,501::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:33:44,503::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:33:44,503::task::1185::TaskManager.Task::(prepare) Task=`da04df12-99ab-46e8-a035-51ed9eb4efc5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:33:44,503::task::595::TaskManager.Task::(_updateState) Task=`da04df12-99ab-46e8-a035-51ed9eb4efc5`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:33:44,504::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:33:44,504::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:33:44,505::task::990::TaskManager.Task::(_decref) Task=`da04df12-99ab-46e8-a035-51ed9eb4efc5`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:33:44,509::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:33:44,509::task::595::TaskManager.Task::(_updateState) Task=`e3e59120-a447-413a-aa16-69ad03cda88e`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:33:44,510::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:33:44,510::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`833e044a-37dc-42cc-9e3a-e2ce5d0d2446`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:33:44,510::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:33:44,511::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:33:44,511::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`833e044a-37dc-42cc-9e3a-e2ce5d0d2446`::Granted request >Thread-135152::DEBUG::2014-07-14 16:33:44,512::task::827::TaskManager.Task::(resourceAcquired) Task=`e3e59120-a447-413a-aa16-69ad03cda88e`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:33:44,512::task::990::TaskManager.Task::(_decref) Task=`e3e59120-a447-413a-aa16-69ad03cda88e`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:33:44,517::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341673299968', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:33:44,517::task::1185::TaskManager.Task::(prepare) Task=`e3e59120-a447-413a-aa16-69ad03cda88e`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341673299968', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:33:44,517::task::595::TaskManager.Task::(_updateState) Task=`e3e59120-a447-413a-aa16-69ad03cda88e`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:33:44,518::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:33:44,518::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:33:44,518::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:33:44,519::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:33:44,519::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:33:44,519::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:33:44,519::task::990::TaskManager.Task::(_decref) Task=`e3e59120-a447-413a-aa16-69ad03cda88e`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:33:45,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:45,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029742 s, 34.4 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:33:47,228::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:33:47,228::task::595::TaskManager.Task::(_updateState) Task=`570659f8-d995-4f17-a765-fd79984a68f7`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:33:47,229::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:33:47,229::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:33:47,229::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:33:47,229::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:33:47,229::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:33:47,231::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:33:47,232::task::1185::TaskManager.Task::(prepare) Task=`570659f8-d995-4f17-a765-fd79984a68f7`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:33:47,232::task::595::TaskManager.Task::(_updateState) Task=`570659f8-d995-4f17-a765-fd79984a68f7`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:33:47,234::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:33:47,235::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:33:47,237::task::990::TaskManager.Task::(_decref) Task=`570659f8-d995-4f17-a765-fd79984a68f7`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:33:47,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:47,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0252155 s, 40.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:49,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:49,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314322 s, 32.6 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:33:49,964::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:33:49,973::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000185655 s, 1.9 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:33:51,184::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:33:51,194::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000224254 s, 2.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:51,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:51,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03021 s, 33.9 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:33:52,685::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:33:52,693::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.00023191 s, 2.8 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:33:53,406::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 63041fa9-e093-4b44-b36f-f39f16d3974f >Thread-11641::DEBUG::2014-07-14 16:33:53,412::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f >Thread-11641::DEBUG::2014-07-14 16:33:53,413::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-11641::DEBUG::2014-07-14 16:33:53,414::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=colnas03_EXPORT', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=94ed7a19-fade-4bd6-83f2-2cbb2f730b95', 'REMOTE_PATH=10.10.30.253:/var/nas3/OVirtEXP', 'ROLE=Regular', 'SDUUID=63041fa9-e093-4b44-b36f-f39f16d3974f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=05042021c79752349f1701a69f9049b70f993176'] >Thread-11641::DEBUG::2014-07-14 16:33:53,416::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-11641::INFO::2014-07-14 16:33:53,416::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 63041fa9-e093-4b44-b36f-f39f16d3974f_imageNS already registered >Thread-11641::INFO::2014-07-14 16:33:53,416::sd::391::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 63041fa9-e093-4b44-b36f-f39f16d3974f_volumeNS already registered >Thread-11641::DEBUG::2014-07-14 16:33:53,419::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:33:53,427::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000400894 s, 905 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:33:53,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:53,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310743 s, 33.0 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:33:54,508::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:33:54,517::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000234605 s, 2.4 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:33:54,743::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:33:54,743::task::595::TaskManager.Task::(_updateState) Task=`48674d56-69fd-4538-91dd-69cd4bbc95d3`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:33:54,744::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:33:54,744::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:33:54,744::task::1185::TaskManager.Task::(prepare) Task=`48674d56-69fd-4538-91dd-69cd4bbc95d3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:33:54,744::task::595::TaskManager.Task::(_updateState) Task=`48674d56-69fd-4538-91dd-69cd4bbc95d3`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:33:54,744::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:33:54,745::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:33:54,745::task::990::TaskManager.Task::(_decref) Task=`48674d56-69fd-4538-91dd-69cd4bbc95d3`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:33:54,748::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:33:54,748::task::595::TaskManager.Task::(_updateState) Task=`f2d539c2-e8c2-4a76-962b-f7758df49eee`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:33:54,749::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:33:54,749::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`2d114758-b71b-47f4-add2-4f1457cd7629`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:33:54,749::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:33:54,749::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:33:54,750::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`2d114758-b71b-47f4-add2-4f1457cd7629`::Granted request >Thread-135152::DEBUG::2014-07-14 16:33:54,750::task::827::TaskManager.Task::(resourceAcquired) Task=`f2d539c2-e8c2-4a76-962b-f7758df49eee`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:33:54,750::task::990::TaskManager.Task::(_decref) Task=`f2d539c2-e8c2-4a76-962b-f7758df49eee`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:33:54,754::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3338197270528', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:33:54,754::task::1185::TaskManager.Task::(prepare) Task=`f2d539c2-e8c2-4a76-962b-f7758df49eee`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3338197270528', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:33:54,754::task::595::TaskManager.Task::(_updateState) Task=`f2d539c2-e8c2-4a76-962b-f7758df49eee`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:33:54,754::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:33:54,755::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:33:54,755::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:33:54,755::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:33:54,755::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:33:54,755::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:33:54,756::task::990::TaskManager.Task::(_decref) Task=`f2d539c2-e8c2-4a76-962b-f7758df49eee`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:33:55,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:55,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030644 s, 33.4 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:33:57,245::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:33:57,245::task::595::TaskManager.Task::(_updateState) Task=`102c1b07-77e0-4d42-b2fd-64a98534ef76`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:33:57,245::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:33:57,245::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:33:57,246::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:33:57,246::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:33:57,246::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:33:57,246::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:33:57,246::task::1185::TaskManager.Task::(prepare) Task=`102c1b07-77e0-4d42-b2fd-64a98534ef76`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:33:57,246::task::595::TaskManager.Task::(_updateState) Task=`102c1b07-77e0-4d42-b2fd-64a98534ef76`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:33:57,246::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:33:57,247::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:33:57,247::task::990::TaskManager.Task::(_decref) Task=`102c1b07-77e0-4d42-b2fd-64a98534ef76`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:33:57,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:57,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0240879 s, 42.5 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:33:58,494::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.0596871376 thisRx 6698584 thisTx 2880361536 samples [(1405348429.257551, 1384849171760, 1393836042288), (1405348431.272845, 1384850575100, 1394560708020), (1405348433.287603, 1384853059744, 1395278909100), (1405348435.302533, 1384854469536, 1395992825628), (1405348437.317238, 1384855870344, 1396716403824)] >Thread-135151::DEBUG::2014-07-14 16:33:58,495::task::595::TaskManager.Task::(_updateState) Task=`4b7d629d-7666-4b39-98b0-6708f1fc174b`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:33:58,495::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:33:58,496::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023191', 'lastCheck': '5.8', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000224254', 'lastCheck': '7.3', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000185655', 'lastCheck': '8.5', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000400894', 'lastCheck': '5.1', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000234605', 'lastCheck': '4.0', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:33:58,496::task::1185::TaskManager.Task::(prepare) Task=`4b7d629d-7666-4b39-98b0-6708f1fc174b`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023191', 'lastCheck': '5.8', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000224254', 'lastCheck': '7.3', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000185655', 'lastCheck': '8.5', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000400894', 'lastCheck': '5.1', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000234605', 'lastCheck': '4.0', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:33:58,496::task::595::TaskManager.Task::(_updateState) Task=`4b7d629d-7666-4b39-98b0-6708f1fc174b`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:33:58,496::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:33:58,496::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:33:58,497::task::990::TaskManager.Task::(_decref) Task=`4b7d629d-7666-4b39-98b0-6708f1fc174b`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:33:59,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:33:59,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0260511 s, 39.3 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:33:59,978::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:33:59,987::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.00019405 s, 1.8 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:34:01,201::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:34:01,210::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000198085 s, 2.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:34:01,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:01,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307932 s, 33.3 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:34:02,700::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:34:02,708::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000175685 s, 3.7 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:34:03,433::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:34:03,442::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000205174 s, 1.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:34:03,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:03,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273116 s, 37.5 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:34:04,523::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:34:04,531::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000211944 s, 2.6 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:34:04,977::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:34:04,977::task::595::TaskManager.Task::(_updateState) Task=`e832200b-fe55-42a7-ad95-9fab754c3419`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:34:04,978::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:34:04,978::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:34:04,978::task::1185::TaskManager.Task::(prepare) Task=`e832200b-fe55-42a7-ad95-9fab754c3419`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:34:04,978::task::595::TaskManager.Task::(_updateState) Task=`e832200b-fe55-42a7-ad95-9fab754c3419`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:34:04,978::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:34:04,979::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:34:04,979::task::990::TaskManager.Task::(_decref) Task=`e832200b-fe55-42a7-ad95-9fab754c3419`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:34:04,982::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:34:04,982::task::595::TaskManager.Task::(_updateState) Task=`f4e869e7-b3ac-4491-8a78-78998d26c41f`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:34:04,982::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:34:04,983::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`47909d4a-f286-4aa9-81e9-e2e4dbda4abb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:34:04,983::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:34:04,983::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:34:04,984::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`47909d4a-f286-4aa9-81e9-e2e4dbda4abb`::Granted request >Thread-135152::DEBUG::2014-07-14 16:34:04,984::task::827::TaskManager.Task::(resourceAcquired) Task=`f4e869e7-b3ac-4491-8a78-78998d26c41f`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:34:04,984::task::990::TaskManager.Task::(_decref) Task=`f4e869e7-b3ac-4491-8a78-78998d26c41f`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:34:04,988::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3334713901056', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:34:04,988::task::1185::TaskManager.Task::(prepare) Task=`f4e869e7-b3ac-4491-8a78-78998d26c41f`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3334713901056', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:34:04,988::task::595::TaskManager.Task::(_updateState) Task=`f4e869e7-b3ac-4491-8a78-78998d26c41f`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:34:04,988::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:34:04,988::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:34:04,989::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:34:04,989::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:34:04,989::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:34:04,989::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:34:04,989::task::990::TaskManager.Task::(_decref) Task=`f4e869e7-b3ac-4491-8a78-78998d26c41f`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:34:05,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:06,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0224711 s, 45.6 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:34:07,251::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:34:07,252::task::595::TaskManager.Task::(_updateState) Task=`ecd6673a-ddfc-4d9d-9f8a-c6cd20a0f6e9`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:34:07,252::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:34:07,252::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:34:07,253::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:34:07,253::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:34:07,253::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:34:07,253::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:34:07,253::task::1185::TaskManager.Task::(prepare) Task=`ecd6673a-ddfc-4d9d-9f8a-c6cd20a0f6e9`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:34:07,254::task::595::TaskManager.Task::(_updateState) Task=`ecd6673a-ddfc-4d9d-9f8a-c6cd20a0f6e9`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:34:07,254::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:34:07,254::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:34:07,254::task::990::TaskManager.Task::(_decref) Task=`ecd6673a-ddfc-4d9d-9f8a-c6cd20a0f6e9`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:34:08,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:08,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280875 s, 36.5 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:34:09,993::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:34:10,001::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000222006 s, 1.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:34:10,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:10,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285183 s, 35.9 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:34:11,218::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:34:11,228::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00177371 s, 314 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:34:12,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:12,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02329 s, 44.0 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:34:12,715::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:34:12,724::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000284629 s, 2.3 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:34:13,448::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:34:13,456::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000179737 s, 2.0 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:34:13,651::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.05906701088 thisRx 5557636 thisTx 2721893316 samples [(1405348445.375983, 1384863672540, 1399623721932), (1405348447.390535, 1384865047788, 1400254660744), (1405348449.405856, 1384866410268, 1400890881916), (1405348451.420169, 1384867818372, 1401613385928), (1405348453.43505, 1384869230176, 1402345615248)] >Thread-135151::DEBUG::2014-07-14 16:34:13,651::task::595::TaskManager.Task::(_updateState) Task=`af070962-9882-4419-8fa9-aabc225a2997`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:34:13,652::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:34:13,652::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284629', 'lastCheck': '0.9', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00177371', 'lastCheck': '2.4', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000222006', 'lastCheck': '3.6', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000179737', 'lastCheck': '0.2', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000211944', 'lastCheck': '9.1', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:34:13,652::task::1185::TaskManager.Task::(prepare) Task=`af070962-9882-4419-8fa9-aabc225a2997`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284629', 'lastCheck': '0.9', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00177371', 'lastCheck': '2.4', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000222006', 'lastCheck': '3.6', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000179737', 'lastCheck': '0.2', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000211944', 'lastCheck': '9.1', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:34:13,652::task::595::TaskManager.Task::(_updateState) Task=`af070962-9882-4419-8fa9-aabc225a2997`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:34:13,653::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:34:13,653::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:34:13,653::task::990::TaskManager.Task::(_decref) Task=`af070962-9882-4419-8fa9-aabc225a2997`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:34:14,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:14,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291242 s, 35.2 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:34:14,537::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:34:14,546::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000214464 s, 2.6 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:34:15,243::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:34:15,244::task::595::TaskManager.Task::(_updateState) Task=`a8b1287e-8356-4c93-9a1c-f465eac6e3b4`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:34:15,244::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:34:15,245::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:34:15,245::task::1185::TaskManager.Task::(prepare) Task=`a8b1287e-8356-4c93-9a1c-f465eac6e3b4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:34:15,245::task::595::TaskManager.Task::(_updateState) Task=`a8b1287e-8356-4c93-9a1c-f465eac6e3b4`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:34:15,246::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:34:15,246::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:34:15,246::task::990::TaskManager.Task::(_decref) Task=`a8b1287e-8356-4c93-9a1c-f465eac6e3b4`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:34:15,250::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:34:15,250::task::595::TaskManager.Task::(_updateState) Task=`318c60e5-512e-423d-b91e-d72d9e27536d`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:34:15,250::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:34:15,251::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`a2c82899-28d5-402e-b9ef-c86a6c037104`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:34:15,251::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:34:15,251::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:34:15,252::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`a2c82899-28d5-402e-b9ef-c86a6c037104`::Granted request >Thread-135152::DEBUG::2014-07-14 16:34:15,252::task::827::TaskManager.Task::(resourceAcquired) Task=`318c60e5-512e-423d-b91e-d72d9e27536d`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:34:15,252::task::990::TaskManager.Task::(_decref) Task=`318c60e5-512e-423d-b91e-d72d9e27536d`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:34:15,257::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3331380477952', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:34:15,257::task::1185::TaskManager.Task::(prepare) Task=`318c60e5-512e-423d-b91e-d72d9e27536d`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3331380477952', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:34:15,258::task::595::TaskManager.Task::(_updateState) Task=`318c60e5-512e-423d-b91e-d72d9e27536d`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:34:15,258::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:34:15,258::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:34:15,259::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:34:15,259::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:34:15,260::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:34:15,260::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:34:15,260::task::990::TaskManager.Task::(_decref) Task=`318c60e5-512e-423d-b91e-d72d9e27536d`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:34:16,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:16,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306275 s, 33.4 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:34:17,260::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:34:17,260::task::595::TaskManager.Task::(_updateState) Task=`ce71e407-175a-4886-9631-a661bf1bc140`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:34:17,260::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:34:17,261::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:34:17,261::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:34:17,261::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:34:17,261::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:34:17,261::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:34:17,262::task::1185::TaskManager.Task::(prepare) Task=`ce71e407-175a-4886-9631-a661bf1bc140`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:34:17,262::task::595::TaskManager.Task::(_updateState) Task=`ce71e407-175a-4886-9631-a661bf1bc140`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:34:17,262::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:34:17,263::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:34:17,263::task::990::TaskManager.Task::(_decref) Task=`ce71e407-175a-4886-9631-a661bf1bc140`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:34:18,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:18,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315935 s, 32.4 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:34:20,007::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:34:20,015::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000225543 s, 1.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:34:20,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:20,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0220918 s, 46.4 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:34:21,230::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545 >Thread-11634::DEBUG::2014-07-14 16:34:21,242::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545 >Thread-11634::DEBUG::2014-07-14 16:34:21,244::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-11634::DEBUG::2014-07-14 16:34:21,246::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=colnas01_IB', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_DESCRIPTION=Collogia', 'POOL_DOMAINS=965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=5', 'POOL_UUID=94ed7a19-fade-4bd6-83f2-2cbb2f730b95', 'REMOTE_PATH=10.10.30.251:/var/nas1/OVirtIB', 'ROLE=Regular', 'SDUUID=965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=33104b1d06083e25e9500f69ce80b4a66b51257c'] >Thread-11634::DEBUG::2014-07-14 16:34:21,248::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-11634::INFO::2014-07-14 16:34:21,248::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545_imageNS already registered >Thread-11634::INFO::2014-07-14 16:34:21,248::sd::391::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545_volumeNS already registered >Thread-11634::DEBUG::2014-07-14 16:34:21,252::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:34:21,260::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000230115 s, 2.4 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:34:22,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:22,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310387 s, 33.0 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:34:22,731::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:34:22,739::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000173926 s, 3.7 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:34:23,462::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:34:23,470::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000182925 s, 2.0 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:34:24,552::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:34:24,561::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000275119 s, 2.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:34:24,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:24,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302159 s, 33.9 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:34:25,487::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:34:25,487::task::595::TaskManager.Task::(_updateState) Task=`729a3295-e59d-4ecc-84f8-0c1c4330e7b2`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:34:25,487::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:34:25,488::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:34:25,488::task::1185::TaskManager.Task::(prepare) Task=`729a3295-e59d-4ecc-84f8-0c1c4330e7b2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:34:25,488::task::595::TaskManager.Task::(_updateState) Task=`729a3295-e59d-4ecc-84f8-0c1c4330e7b2`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:34:25,488::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:34:25,488::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:34:25,489::task::990::TaskManager.Task::(_decref) Task=`729a3295-e59d-4ecc-84f8-0c1c4330e7b2`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:34:25,492::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:34:25,492::task::595::TaskManager.Task::(_updateState) Task=`4969c58e-3add-4cfb-aeb3-84b5ec9ce4ee`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:34:25,492::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:34:25,493::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`0cf482fd-ed67-47b2-80c9-b97902b65325`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:34:25,493::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:34:25,493::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:34:25,493::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`0cf482fd-ed67-47b2-80c9-b97902b65325`::Granted request >Thread-135152::DEBUG::2014-07-14 16:34:25,494::task::827::TaskManager.Task::(resourceAcquired) Task=`4969c58e-3add-4cfb-aeb3-84b5ec9ce4ee`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:34:25,494::task::990::TaskManager.Task::(_decref) Task=`4969c58e-3add-4cfb-aeb3-84b5ec9ce4ee`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:34:25,498::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3327887671296', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:34:25,498::task::1185::TaskManager.Task::(prepare) Task=`4969c58e-3add-4cfb-aeb3-84b5ec9ce4ee`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3327887671296', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:34:25,498::task::595::TaskManager.Task::(_updateState) Task=`4969c58e-3add-4cfb-aeb3-84b5ec9ce4ee`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:34:25,498::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:34:25,498::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:34:25,498::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:34:25,499::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:34:25,499::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:34:25,499::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:34:25,499::task::990::TaskManager.Task::(_decref) Task=`4969c58e-3add-4cfb-aeb3-84b5ec9ce4ee`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:34:26,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:26,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0253288 s, 40.4 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:34:27,269::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [3baab4a5] >Thread-135151::DEBUG::2014-07-14 16:34:27,270::task::595::TaskManager.Task::(_updateState) Task=`251a3ad2-b226-48f1-a31b-ac6905425e88`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:34:27,270::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:34:27,270::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:34:27,270::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:34:27,271::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:34:27,271::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:34:27,271::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:34:27,271::task::1185::TaskManager.Task::(prepare) Task=`251a3ad2-b226-48f1-a31b-ac6905425e88`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:34:27,271::task::595::TaskManager.Task::(_updateState) Task=`251a3ad2-b226-48f1-a31b-ac6905425e88`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:34:27,271::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:34:27,272::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:34:27,272::task::990::TaskManager.Task::(_decref) Task=`251a3ad2-b226-48f1-a31b-ac6905425e88`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:34:28,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:28,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305894 s, 33.5 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:34:28,817::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.06224703789 thisRx 7967148 thisTx 2876593360 samples [(1405348459.479222, 1384874570024, 1404497154528), (1405348461.494942, 1384876020128, 1405219146272), (1405348463.510966, 1384878535884, 1405931938932), (1405348465.526363, 1384881093416, 1406653411260), (1405348467.541469, 1384882537172, 1407373747888)] >Thread-135151::DEBUG::2014-07-14 16:34:28,817::task::595::TaskManager.Task::(_updateState) Task=`6d4d2053-8448-417b-8299-2222075d9317`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:34:28,818::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:34:28,818::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000173926', 'lastCheck': '6.1', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000230115', 'lastCheck': '7.6', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000225543', 'lastCheck': '8.8', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000182925', 'lastCheck': '5.3', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000275119', 'lastCheck': '4.3', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:34:28,818::task::1185::TaskManager.Task::(prepare) Task=`6d4d2053-8448-417b-8299-2222075d9317`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000173926', 'lastCheck': '6.1', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000230115', 'lastCheck': '7.6', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000225543', 'lastCheck': '8.8', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000182925', 'lastCheck': '5.3', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000275119', 'lastCheck': '4.3', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:34:28,818::task::595::TaskManager.Task::(_updateState) Task=`6d4d2053-8448-417b-8299-2222075d9317`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:34:28,818::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:34:28,819::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:34:28,819::task::990::TaskManager.Task::(_decref) Task=`6d4d2053-8448-417b-8299-2222075d9317`::ref 0 aborting False >Thread-11635::DEBUG::2014-07-14 16:34:30,020::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:34:30,029::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000121113 s, 2.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:34:30,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:30,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030007 s, 34.1 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:34:31,267::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:34:31,276::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000216377 s, 2.6 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:34:32,746::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:34:32,755::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000211932 s, 3.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:34:32,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:32,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314842 s, 32.5 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:34:33,476::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:34:33,486::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000159683 s, 2.3 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:34:34,567::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:34:34,576::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000180225 s, 3.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:34:34,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:35,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313819 s, 32.6 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:34:35,718::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [1e74e3f3] >Thread-135151::DEBUG::2014-07-14 16:34:35,718::task::595::TaskManager.Task::(_updateState) Task=`990505c6-80e4-4a46-b5f0-88caea66b9e8`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:34:35,719::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:34:35,719::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:34:35,719::task::1185::TaskManager.Task::(prepare) Task=`990505c6-80e4-4a46-b5f0-88caea66b9e8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:34:35,719::task::595::TaskManager.Task::(_updateState) Task=`990505c6-80e4-4a46-b5f0-88caea66b9e8`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:34:35,719::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:34:35,720::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:34:35,720::task::990::TaskManager.Task::(_decref) Task=`990505c6-80e4-4a46-b5f0-88caea66b9e8`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:34:35,723::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [1e74e3f3] >Thread-135152::DEBUG::2014-07-14 16:34:35,723::task::595::TaskManager.Task::(_updateState) Task=`11c2eeee-6c24-4612-b4bc-f6cdfe9e92da`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:34:35,724::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:34:35,725::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`2ccf024b-fe50-43a0-a482-9755bd4af4fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:34:35,725::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:34:35,726::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:34:35,726::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`2ccf024b-fe50-43a0-a482-9755bd4af4fb`::Granted request >Thread-135152::DEBUG::2014-07-14 16:34:35,726::task::827::TaskManager.Task::(resourceAcquired) Task=`11c2eeee-6c24-4612-b4bc-f6cdfe9e92da`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:34:35,726::task::990::TaskManager.Task::(_decref) Task=`11c2eeee-6c24-4612-b4bc-f6cdfe9e92da`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:34:35,731::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3324410593280', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:34:35,731::task::1185::TaskManager.Task::(prepare) Task=`11c2eeee-6c24-4612-b4bc-f6cdfe9e92da`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3324410593280', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:34:35,731::task::595::TaskManager.Task::(_updateState) Task=`11c2eeee-6c24-4612-b4bc-f6cdfe9e92da`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:34:35,731::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:34:35,732::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:34:35,732::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:34:35,732::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:34:35,732::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:34:35,732::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:34:35,732::task::990::TaskManager.Task::(_decref) Task=`11c2eeee-6c24-4612-b4bc-f6cdfe9e92da`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:34:37,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:37,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0257807 s, 39.7 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:34:37,283::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:34:37,283::task::595::TaskManager.Task::(_updateState) Task=`e05889e8-7bbd-4c42-ab35-58c56ac10190`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:34:37,284::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:34:37,284::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:34:37,284::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:34:37,284::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:34:37,284::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:34:37,285::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:34:37,285::task::1185::TaskManager.Task::(prepare) Task=`e05889e8-7bbd-4c42-ab35-58c56ac10190`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:34:37,285::task::595::TaskManager.Task::(_updateState) Task=`e05889e8-7bbd-4c42-ab35-58c56ac10190`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:34:37,285::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:34:37,285::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:34:37,286::task::990::TaskManager.Task::(_decref) Task=`e05889e8-7bbd-4c42-ab35-58c56ac10190`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:34:39,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:39,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302037 s, 33.9 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:34:40,038::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:34:40,048::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000153291 s, 2.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:34:41,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:41,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301516 s, 34.0 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:34:41,283::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:34:41,293::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000186706 s, 3.0 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:34:42,761::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:34:42,770::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000172128 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:34:43,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:43,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323864 s, 31.6 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:34:43,497::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:34:43,505::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000135414 s, 2.7 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:34:43,973::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.05875897408 thisRx 6767284 thisTx 2894629976 samples [(1405348475.599864, 1384889320496, 1410284322252), (1405348477.614684, 1384890734416, 1411029498384), (1405348479.62952, 1384892157800, 1411744470340), (1405348481.64432, 1384893579108, 1412461591952), (1405348483.658623, 1384896087780, 1413178952228)] >Thread-135151::DEBUG::2014-07-14 16:34:43,974::task::595::TaskManager.Task::(_updateState) Task=`bd87c0c4-86f4-4e45-9257-6ca5e7fb9f42`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:34:43,974::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:34:43,974::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000172128', 'lastCheck': '1.2', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000186706', 'lastCheck': '2.7', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000153291', 'lastCheck': '3.9', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000135414', 'lastCheck': '0.5', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000180225', 'lastCheck': '9.4', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:34:43,975::task::1185::TaskManager.Task::(prepare) Task=`bd87c0c4-86f4-4e45-9257-6ca5e7fb9f42`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000172128', 'lastCheck': '1.2', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000186706', 'lastCheck': '2.7', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000153291', 'lastCheck': '3.9', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000135414', 'lastCheck': '0.5', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000180225', 'lastCheck': '9.4', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:34:43,975::task::595::TaskManager.Task::(_updateState) Task=`bd87c0c4-86f4-4e45-9257-6ca5e7fb9f42`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:34:43,975::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:34:43,975::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:34:43,975::task::990::TaskManager.Task::(_decref) Task=`bd87c0c4-86f4-4e45-9257-6ca5e7fb9f42`::ref 0 aborting False >Thread-11647::DEBUG::2014-07-14 16:34:44,582::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:34:44,591::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00022177 s, 2.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:34:45,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:45,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027957 s, 36.6 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:34:45,969::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [6bda814d] >Thread-135151::DEBUG::2014-07-14 16:34:45,970::task::595::TaskManager.Task::(_updateState) Task=`d91b7ab6-9dc2-46c0-9dda-78a72570f3c3`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:34:45,970::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:34:45,970::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:34:45,970::task::1185::TaskManager.Task::(prepare) Task=`d91b7ab6-9dc2-46c0-9dda-78a72570f3c3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:34:45,971::task::595::TaskManager.Task::(_updateState) Task=`d91b7ab6-9dc2-46c0-9dda-78a72570f3c3`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:34:45,971::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:34:45,971::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:34:45,971::task::990::TaskManager.Task::(_decref) Task=`d91b7ab6-9dc2-46c0-9dda-78a72570f3c3`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:34:45,975::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [6bda814d] >Thread-135152::DEBUG::2014-07-14 16:34:45,976::task::595::TaskManager.Task::(_updateState) Task=`449b1056-ab41-434a-9d62-3132594f8e3f`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:34:45,976::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:34:45,977::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`346829f6-39b3-4f33-9440-71ecf7cdc333`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:34:45,977::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:34:45,977::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:34:45,977::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`346829f6-39b3-4f33-9440-71ecf7cdc333`::Granted request >Thread-135152::DEBUG::2014-07-14 16:34:45,978::task::827::TaskManager.Task::(resourceAcquired) Task=`449b1056-ab41-434a-9d62-3132594f8e3f`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:34:45,978::task::990::TaskManager.Task::(_decref) Task=`449b1056-ab41-434a-9d62-3132594f8e3f`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:34:45,984::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3320878989312', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:34:45,984::task::1185::TaskManager.Task::(prepare) Task=`449b1056-ab41-434a-9d62-3132594f8e3f`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3320878989312', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:34:45,984::task::595::TaskManager.Task::(_updateState) Task=`449b1056-ab41-434a-9d62-3132594f8e3f`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:34:45,984::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:34:45,984::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:34:45,985::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:34:45,985::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:34:45,985::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:34:45,985::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:34:45,986::task::990::TaskManager.Task::(_decref) Task=`449b1056-ab41-434a-9d62-3132594f8e3f`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:34:47,293::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:34:47,293::task::595::TaskManager.Task::(_updateState) Task=`981f58f3-7d75-400c-8e97-edb7c1f980dd`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:34:47,294::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:34:47,294::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:34:47,294::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:34:47,294::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:34:47,295::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:34:47,295::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:34:47,295::task::1185::TaskManager.Task::(prepare) Task=`981f58f3-7d75-400c-8e97-edb7c1f980dd`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:34:47,296::task::595::TaskManager.Task::(_updateState) Task=`981f58f3-7d75-400c-8e97-edb7c1f980dd`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:34:47,296::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:34:47,296::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:34:47,296::task::990::TaskManager.Task::(_decref) Task=`981f58f3-7d75-400c-8e97-edb7c1f980dd`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:34:47,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:47,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0226855 s, 45.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:34:49,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:49,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280679 s, 36.5 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:34:50,054::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:34:50,063::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000163916 s, 2.2 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:34:51,303::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:34:51,311::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000196095 s, 2.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:34:51,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:51,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281212 s, 36.4 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:34:52,777::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:34:52,786::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000196679 s, 3.3 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:34:53,510::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:34:53,519::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000911644 s, 398 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:34:53,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:53,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027578 s, 37.1 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:34:54,597::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:34:54,605::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000250145 s, 2.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:34:55,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:55,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285568 s, 35.9 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:34:56,189::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:34:56,190::task::595::TaskManager.Task::(_updateState) Task=`bc560385-ee70-44c9-a5cc-f70f36de6935`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:34:56,190::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:34:56,190::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:34:56,191::task::1185::TaskManager.Task::(prepare) Task=`bc560385-ee70-44c9-a5cc-f70f36de6935`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:34:56,191::task::595::TaskManager.Task::(_updateState) Task=`bc560385-ee70-44c9-a5cc-f70f36de6935`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:34:56,191::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:34:56,191::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:34:56,191::task::990::TaskManager.Task::(_decref) Task=`bc560385-ee70-44c9-a5cc-f70f36de6935`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:34:56,195::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:34:56,195::task::595::TaskManager.Task::(_updateState) Task=`a0aa0575-2b02-4af1-9c24-ddb6a719eb1e`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:34:56,195::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:34:56,196::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`9eed5225-515f-4a22-a008-d4da994a4f53`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:34:56,196::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:34:56,196::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:34:56,196::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`9eed5225-515f-4a22-a008-d4da994a4f53`::Granted request >Thread-135152::DEBUG::2014-07-14 16:34:56,197::task::827::TaskManager.Task::(resourceAcquired) Task=`a0aa0575-2b02-4af1-9c24-ddb6a719eb1e`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:34:56,197::task::990::TaskManager.Task::(_decref) Task=`a0aa0575-2b02-4af1-9c24-ddb6a719eb1e`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:34:56,200::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3317411348480', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:34:56,200::task::1185::TaskManager.Task::(prepare) Task=`a0aa0575-2b02-4af1-9c24-ddb6a719eb1e`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3317411348480', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:34:56,201::task::595::TaskManager.Task::(_updateState) Task=`a0aa0575-2b02-4af1-9c24-ddb6a719eb1e`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:34:56,201::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:34:56,201::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:34:56,201::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:34:56,202::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:34:56,202::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:34:56,202::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:34:56,202::task::990::TaskManager.Task::(_decref) Task=`a0aa0575-2b02-4af1-9c24-ddb6a719eb1e`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:34:57,301::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [3baab4a5] >Thread-135151::DEBUG::2014-07-14 16:34:57,302::task::595::TaskManager.Task::(_updateState) Task=`4d885f20-99af-44ba-a27c-9d50e252750c`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:34:57,302::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:34:57,302::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:34:57,302::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:34:57,302::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:34:57,302::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:34:57,302::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:34:57,303::task::1185::TaskManager.Task::(prepare) Task=`4d885f20-99af-44ba-a27c-9d50e252750c`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:34:57,303::task::595::TaskManager.Task::(_updateState) Task=`4d885f20-99af-44ba-a27c-9d50e252750c`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:34:57,303::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:34:57,303::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:34:57,303::task::990::TaskManager.Task::(_decref) Task=`4d885f20-99af-44ba-a27c-9d50e252750c`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:34:57,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:57,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0226012 s, 45.3 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:34:59,120::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.05908417702 thisRx 6710308 thisTx 2865339856 samples [(1405348489.703888, 1384901387400, 1415337651420), (1405348491.718436, 1384902789348, 1416058014096), (1405348493.733183, 1384904206380, 1416778371976), (1405348495.747834, 1384906683260, 1417471788536), (1405348497.762972, 1384908097708, 1418202991276)] >Thread-135151::DEBUG::2014-07-14 16:34:59,121::task::595::TaskManager.Task::(_updateState) Task=`d6a02288-1aa6-4cc9-8222-615d4647331e`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:34:59,121::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:34:59,122::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000196679', 'lastCheck': '6.3', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000196095', 'lastCheck': '7.8', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000163916', 'lastCheck': '9.1', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000911644', 'lastCheck': '5.6', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250145', 'lastCheck': '4.5', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:34:59,122::task::1185::TaskManager.Task::(prepare) Task=`d6a02288-1aa6-4cc9-8222-615d4647331e`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000196679', 'lastCheck': '6.3', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000196095', 'lastCheck': '7.8', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000163916', 'lastCheck': '9.1', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000911644', 'lastCheck': '5.6', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250145', 'lastCheck': '4.5', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:34:59,122::task::595::TaskManager.Task::(_updateState) Task=`d6a02288-1aa6-4cc9-8222-615d4647331e`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:34:59,122::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:34:59,122::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:34:59,123::task::990::TaskManager.Task::(_decref) Task=`d6a02288-1aa6-4cc9-8222-615d4647331e`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:34:59,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:34:59,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0252976 s, 40.5 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:35:00,068::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:35:00,077::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000236161 s, 1.5 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:35:01,319::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:35:01,328::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00019653 s, 2.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:01,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:01,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307738 s, 33.3 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:35:02,793::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:35:02,802::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000285663 s, 2.3 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:35:03,525::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:35:03,533::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000126142 s, 2.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:03,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:03,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299062 s, 34.2 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:35:04,612::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:35:04,620::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000180153 s, 3.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:05,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:06,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024334 s, 42.1 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:35:06,466::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:35:06,467::task::595::TaskManager.Task::(_updateState) Task=`3d774ad4-bc35-423d-8894-7c70b3c4c8a4`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:35:06,467::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:35:06,468::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:35:06,468::task::1185::TaskManager.Task::(prepare) Task=`3d774ad4-bc35-423d-8894-7c70b3c4c8a4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:35:06,468::task::595::TaskManager.Task::(_updateState) Task=`3d774ad4-bc35-423d-8894-7c70b3c4c8a4`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:35:06,468::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:35:06,468::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:35:06,468::task::990::TaskManager.Task::(_decref) Task=`3d774ad4-bc35-423d-8894-7c70b3c4c8a4`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:35:06,472::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:35:06,472::task::595::TaskManager.Task::(_updateState) Task=`693cfb27-cfa0-4266-85bd-4eff5b500f1d`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:35:06,473::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:35:06,473::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`96961617-5aa5-420e-be79-62a2d84598de`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:35:06,473::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:35:06,473::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:35:06,474::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`96961617-5aa5-420e-be79-62a2d84598de`::Granted request >Thread-135152::DEBUG::2014-07-14 16:35:06,474::task::827::TaskManager.Task::(resourceAcquired) Task=`693cfb27-cfa0-4266-85bd-4eff5b500f1d`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:35:06,474::task::990::TaskManager.Task::(_decref) Task=`693cfb27-cfa0-4266-85bd-4eff5b500f1d`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:35:06,478::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3313930076160', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:35:06,478::task::1185::TaskManager.Task::(prepare) Task=`693cfb27-cfa0-4266-85bd-4eff5b500f1d`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3313930076160', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:35:06,478::task::595::TaskManager.Task::(_updateState) Task=`693cfb27-cfa0-4266-85bd-4eff5b500f1d`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:35:06,479::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:35:06,479::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:35:06,479::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:35:06,479::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:35:06,479::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:35:06,480::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:35:06,480::task::990::TaskManager.Task::(_decref) Task=`693cfb27-cfa0-4266-85bd-4eff5b500f1d`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:35:07,309::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:35:07,309::task::595::TaskManager.Task::(_updateState) Task=`21f4dc8a-5a8c-4501-9e84-efc377bce0e3`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:35:07,309::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:35:07,309::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:35:07,310::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:35:07,310::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:35:07,310::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:35:07,310::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:35:07,310::task::1185::TaskManager.Task::(prepare) Task=`21f4dc8a-5a8c-4501-9e84-efc377bce0e3`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:35:07,311::task::595::TaskManager.Task::(_updateState) Task=`21f4dc8a-5a8c-4501-9e84-efc377bce0e3`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:35:07,311::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:35:07,311::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:35:07,311::task::990::TaskManager.Task::(_decref) Task=`21f4dc8a-5a8c-4501-9e84-efc377bce0e3`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:35:08,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:08,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299679 s, 34.2 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:35:10,082::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:35:10,091::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.0002401 s, 1.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:10,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:10,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300088 s, 34.1 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:35:11,334::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:35:11,343::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000234208 s, 2.4 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:12,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:12,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0250186 s, 40.9 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:35:12,810::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:35:12,819::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000294169 s, 2.2 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:35:13,539::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:35:13,548::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000266598 s, 1.4 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:14,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:14,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311211 s, 32.9 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:35:14,307::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.05884099007 thisRx 5650428 thisTx 2900870548 samples [(1405348505.850628, 1384914852800, 1421114610300), (1405348507.865376, 1384916260436, 1421837138912), (1405348509.880213, 1384917684620, 1422569351452), (1405348511.89485, 1384919084900, 1423286469536), (1405348513.909469, 1384920503228, 1424015480848)] >Thread-135151::DEBUG::2014-07-14 16:35:14,311::task::595::TaskManager.Task::(_updateState) Task=`7a8da480-d5bb-4b5f-9108-c5a2f54afbcd`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:35:14,312::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:35:14,314::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294169', 'lastCheck': '1.5', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000234208', 'lastCheck': '3.0', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0002401', 'lastCheck': '4.2', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000266598', 'lastCheck': '0.8', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000180153', 'lastCheck': '9.7', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:35:14,315::task::1185::TaskManager.Task::(prepare) Task=`7a8da480-d5bb-4b5f-9108-c5a2f54afbcd`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294169', 'lastCheck': '1.5', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000234208', 'lastCheck': '3.0', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0002401', 'lastCheck': '4.2', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000266598', 'lastCheck': '0.8', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000180153', 'lastCheck': '9.7', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:35:14,316::task::595::TaskManager.Task::(_updateState) Task=`7a8da480-d5bb-4b5f-9108-c5a2f54afbcd`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:35:14,316::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:35:14,317::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:35:14,318::task::990::TaskManager.Task::(_decref) Task=`7a8da480-d5bb-4b5f-9108-c5a2f54afbcd`::ref 0 aborting False >Thread-11647::DEBUG::2014-07-14 16:35:14,622::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 272ec473-6041-42ee-bd1a-732789dd18d4 >Thread-11647::DEBUG::2014-07-14 16:35:14,628::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4 >Thread-11647::DEBUG::2014-07-14 16:35:14,628::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-11647::DEBUG::2014-07-14 16:35:14,630::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=colnas02_IB', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_DESCRIPTION=Collogia', 'POOL_DOMAINS=965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=5', 'POOL_UUID=94ed7a19-fade-4bd6-83f2-2cbb2f730b95', 'REMOTE_PATH=10.10.30.252:/var/nas2/OVirtIB', 'ROLE=Regular', 'SDUUID=272ec473-6041-42ee-bd1a-732789dd18d4', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=101ee262507ad44a448dbc39eebf0320e49150e4'] >Thread-11647::DEBUG::2014-07-14 16:35:14,632::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-11647::INFO::2014-07-14 16:35:14,632::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 272ec473-6041-42ee-bd1a-732789dd18d4_imageNS already registered >Thread-11647::INFO::2014-07-14 16:35:14,632::sd::391::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 272ec473-6041-42ee-bd1a-732789dd18d4_volumeNS already registered >Thread-11647::DEBUG::2014-07-14 16:35:14,635::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:35:14,644::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000628837 s, 886 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:16,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:16,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311844 s, 32.8 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:35:16,704::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:35:16,704::task::595::TaskManager.Task::(_updateState) Task=`3d5d697f-c721-4159-b49c-afa4d308ec5e`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:35:16,705::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:35:16,705::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:35:16,705::task::1185::TaskManager.Task::(prepare) Task=`3d5d697f-c721-4159-b49c-afa4d308ec5e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:35:16,705::task::595::TaskManager.Task::(_updateState) Task=`3d5d697f-c721-4159-b49c-afa4d308ec5e`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:35:16,705::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:35:16,706::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:35:16,706::task::990::TaskManager.Task::(_decref) Task=`3d5d697f-c721-4159-b49c-afa4d308ec5e`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:35:16,709::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:35:16,709::task::595::TaskManager.Task::(_updateState) Task=`232e0411-f10c-47bb-9bb9-7a1d42f9c788`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:35:16,710::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:35:16,710::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`d2e41e20-c8fe-48cf-b782-7fe0bd026e51`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:35:16,710::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:35:16,710::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:35:16,711::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`d2e41e20-c8fe-48cf-b782-7fe0bd026e51`::Granted request >Thread-135152::DEBUG::2014-07-14 16:35:16,711::task::827::TaskManager.Task::(resourceAcquired) Task=`232e0411-f10c-47bb-9bb9-7a1d42f9c788`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:35:16,711::task::990::TaskManager.Task::(_decref) Task=`232e0411-f10c-47bb-9bb9-7a1d42f9c788`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:35:16,715::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3310429929472', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:35:16,715::task::1185::TaskManager.Task::(prepare) Task=`232e0411-f10c-47bb-9bb9-7a1d42f9c788`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3310429929472', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:35:16,715::task::595::TaskManager.Task::(_updateState) Task=`232e0411-f10c-47bb-9bb9-7a1d42f9c788`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:35:16,715::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:35:16,716::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:35:16,716::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:35:16,716::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:35:16,716::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:35:16,716::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:35:16,717::task::990::TaskManager.Task::(_decref) Task=`232e0411-f10c-47bb-9bb9-7a1d42f9c788`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:35:17,316::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:35:17,317::task::595::TaskManager.Task::(_updateState) Task=`7356fbf9-5c64-4c19-b7b3-461fafc24fd2`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:35:17,317::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:35:17,317::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:35:17,317::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:35:17,317::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:35:17,318::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:35:17,318::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:35:17,318::task::1185::TaskManager.Task::(prepare) Task=`7356fbf9-5c64-4c19-b7b3-461fafc24fd2`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:35:17,318::task::595::TaskManager.Task::(_updateState) Task=`7356fbf9-5c64-4c19-b7b3-461fafc24fd2`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:35:17,318::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:35:17,318::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:35:17,319::task::990::TaskManager.Task::(_decref) Task=`7356fbf9-5c64-4c19-b7b3-461fafc24fd2`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:35:18,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:18,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.025142 s, 40.7 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:35:20,097::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:35:20,106::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000198377 s, 1.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:20,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:20,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0250252 s, 40.9 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:35:21,351::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:35:21,360::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000221336 s, 2.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:22,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:22,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298555 s, 34.3 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:35:22,827::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:35:22,835::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000177206 s, 3.6 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:35:23,553::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:35:23,562::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000174035 s, 2.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:24,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:35:24,671::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:35:24,682::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000162802 s, 3.4 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:24,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0671716 s, 15.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:26,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:26,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0222262 s, 46.1 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:35:26,940::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:35:26,941::task::595::TaskManager.Task::(_updateState) Task=`ee5a199a-1f00-4bcd-8bae-9a16cd24d593`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:35:26,941::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:35:26,941::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:35:26,942::task::1185::TaskManager.Task::(prepare) Task=`ee5a199a-1f00-4bcd-8bae-9a16cd24d593`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:35:26,942::task::595::TaskManager.Task::(_updateState) Task=`ee5a199a-1f00-4bcd-8bae-9a16cd24d593`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:35:26,942::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:35:26,942::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:35:26,942::task::990::TaskManager.Task::(_decref) Task=`ee5a199a-1f00-4bcd-8bae-9a16cd24d593`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:35:26,946::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:35:26,946::task::595::TaskManager.Task::(_updateState) Task=`8e89791c-97d5-44cc-b8c3-c9e0a2a89dd1`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:35:26,946::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:35:26,947::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`5c08ad59-c5f6-4568-bc50-498a7bb50a64`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:35:26,947::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:35:26,947::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:35:26,947::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`5c08ad59-c5f6-4568-bc50-498a7bb50a64`::Granted request >Thread-135152::DEBUG::2014-07-14 16:35:26,948::task::827::TaskManager.Task::(resourceAcquired) Task=`8e89791c-97d5-44cc-b8c3-c9e0a2a89dd1`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:35:26,948::task::990::TaskManager.Task::(_decref) Task=`8e89791c-97d5-44cc-b8c3-c9e0a2a89dd1`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:35:26,951::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3306939219968', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:35:26,952::task::1185::TaskManager.Task::(prepare) Task=`8e89791c-97d5-44cc-b8c3-c9e0a2a89dd1`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3306939219968', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:35:26,952::task::595::TaskManager.Task::(_updateState) Task=`8e89791c-97d5-44cc-b8c3-c9e0a2a89dd1`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:35:26,952::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:35:26,952::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:35:26,952::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:35:26,953::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:35:26,953::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:35:26,953::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:35:26,953::task::990::TaskManager.Task::(_decref) Task=`8e89791c-97d5-44cc-b8c3-c9e0a2a89dd1`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:35:27,324::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [526ebca7] >Thread-135151::DEBUG::2014-07-14 16:35:27,325::task::595::TaskManager.Task::(_updateState) Task=`45fd1db2-9c8b-4c86-b684-d7a0d3e67864`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:35:27,325::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:35:27,325::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:35:27,325::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:35:27,325::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:35:27,326::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:35:27,326::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:35:27,326::task::1185::TaskManager.Task::(prepare) Task=`45fd1db2-9c8b-4c86-b684-d7a0d3e67864`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:35:27,326::task::595::TaskManager.Task::(_updateState) Task=`45fd1db2-9c8b-4c86-b684-d7a0d3e67864`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:35:27,326::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:35:27,326::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:35:27,327::task::990::TaskManager.Task::(_decref) Task=`45fd1db2-9c8b-4c86-b684-d7a0d3e67864`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:35:28,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:28,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281618 s, 36.4 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:35:29,525::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.05902481079 thisRx 7825132 thisTx 2914870060 samples [(1405348519.955552, 1384925800000, 1426164703572), (1405348521.970572, 1384927229796, 1426905535400), (1405348523.985155, 1384928643596, 1427633458340), (1405348526.000019, 1384932225312, 1428356007404), (1405348528.014577, 1384933625132, 1429079573632)] >Thread-135151::DEBUG::2014-07-14 16:35:29,525::task::595::TaskManager.Task::(_updateState) Task=`4011528b-6ff4-4250-86b2-e02f0bc16f6b`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:35:29,525::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:35:29,526::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000177206', 'lastCheck': '6.7', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000221336', 'lastCheck': '8.2', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000198377', 'lastCheck': '9.4', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000174035', 'lastCheck': '6.0', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000162802', 'lastCheck': '4.8', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:35:29,526::task::1185::TaskManager.Task::(prepare) Task=`4011528b-6ff4-4250-86b2-e02f0bc16f6b`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000177206', 'lastCheck': '6.7', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000221336', 'lastCheck': '8.2', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000198377', 'lastCheck': '9.4', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000174035', 'lastCheck': '6.0', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000162802', 'lastCheck': '4.8', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:35:29,526::task::595::TaskManager.Task::(_updateState) Task=`4011528b-6ff4-4250-86b2-e02f0bc16f6b`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:35:29,526::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:35:29,527::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:35:29,527::task::990::TaskManager.Task::(_decref) Task=`4011528b-6ff4-4250-86b2-e02f0bc16f6b`::ref 0 aborting False >Thread-11635::DEBUG::2014-07-14 16:35:30,111::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:35:30,119::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000152998 s, 2.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:30,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:30,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276794 s, 37.0 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:35:31,368::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:35:31,378::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000219214 s, 2.5 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:35:32,842::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:35:32,851::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000214325 s, 3.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:32,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:32,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278599 s, 36.8 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:35:33,568::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:35:33,576::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000211899 s, 1.7 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:35:34,691::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:35:34,700::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000135999 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:34,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:35,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0290163 s, 35.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:37,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:37,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0225885 s, 45.3 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:35:37,183::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:35:37,184::task::595::TaskManager.Task::(_updateState) Task=`aca880b8-036f-41e4-9be1-c9aff58a4231`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:35:37,184::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:35:37,185::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:35:37,185::task::1185::TaskManager.Task::(prepare) Task=`aca880b8-036f-41e4-9be1-c9aff58a4231`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:35:37,185::task::595::TaskManager.Task::(_updateState) Task=`aca880b8-036f-41e4-9be1-c9aff58a4231`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:35:37,185::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:35:37,185::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:35:37,185::task::990::TaskManager.Task::(_decref) Task=`aca880b8-036f-41e4-9be1-c9aff58a4231`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:35:37,189::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:35:37,190::task::595::TaskManager.Task::(_updateState) Task=`4bb66d1a-b7e6-4a20-a24c-d91e865ccd96`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:35:37,190::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:35:37,190::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`d7221ced-036c-43a4-831a-81d46cb287ab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:35:37,190::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:35:37,191::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:35:37,191::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`d7221ced-036c-43a4-831a-81d46cb287ab`::Granted request >Thread-135152::DEBUG::2014-07-14 16:35:37,191::task::827::TaskManager.Task::(resourceAcquired) Task=`4bb66d1a-b7e6-4a20-a24c-d91e865ccd96`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:35:37,191::task::990::TaskManager.Task::(_decref) Task=`4bb66d1a-b7e6-4a20-a24c-d91e865ccd96`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:35:37,195::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3303434878976', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:35:37,195::task::1185::TaskManager.Task::(prepare) Task=`4bb66d1a-b7e6-4a20-a24c-d91e865ccd96`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3303434878976', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:35:37,195::task::595::TaskManager.Task::(_updateState) Task=`4bb66d1a-b7e6-4a20-a24c-d91e865ccd96`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:35:37,196::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:35:37,196::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:35:37,196::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:35:37,196::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:35:37,196::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:35:37,196::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:35:37,197::task::990::TaskManager.Task::(_decref) Task=`4bb66d1a-b7e6-4a20-a24c-d91e865ccd96`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:35:37,331::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:35:37,332::task::595::TaskManager.Task::(_updateState) Task=`2a1dee2f-64b4-4f75-8f37-46ff669b7856`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:35:37,332::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:35:37,332::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:35:37,332::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:35:37,332::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:35:37,332::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:35:37,333::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:35:37,333::task::1185::TaskManager.Task::(prepare) Task=`2a1dee2f-64b4-4f75-8f37-46ff669b7856`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:35:37,333::task::595::TaskManager.Task::(_updateState) Task=`2a1dee2f-64b4-4f75-8f37-46ff669b7856`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:35:37,333::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:35:37,333::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:35:37,333::task::990::TaskManager.Task::(_decref) Task=`2a1dee2f-64b4-4f75-8f37-46ff669b7856`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:35:39,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:39,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0287755 s, 35.6 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:35:40,125::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:35:40,134::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000240229 s, 1.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:41,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:41,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275066 s, 37.2 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:35:41,385::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:35:41,393::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000243852 s, 2.3 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:35:42,857::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:35:42,866::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000155946 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:43,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:43,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281782 s, 36.3 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:35:43,582::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:35:43,591::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000287225 s, 1.3 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:35:44,664::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.05846500397 thisRx 5650568 thisTx 2926728256 samples [(1405348536.073437, 1384940356472, 1431981514404), (1405348538.087961, 1384941764300, 1432705131344), (1405348540.102822, 1384943174612, 1433447024540), (1405348542.117197, 1384944594472, 1434184654928), (1405348544.131902, 1384946007040, 1434908242660)] >Thread-135151::DEBUG::2014-07-14 16:35:44,665::task::595::TaskManager.Task::(_updateState) Task=`d097aa0e-b6e3-4410-85a7-d60ad0c9f023`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:35:44,665::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:35:44,665::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000155946', 'lastCheck': '1.8', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000243852', 'lastCheck': '3.3', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000240229', 'lastCheck': '4.5', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000287225', 'lastCheck': '1.1', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000135999', 'lastCheck': '10.0', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:35:44,665::task::1185::TaskManager.Task::(prepare) Task=`d097aa0e-b6e3-4410-85a7-d60ad0c9f023`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000155946', 'lastCheck': '1.8', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000243852', 'lastCheck': '3.3', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000240229', 'lastCheck': '4.5', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000287225', 'lastCheck': '1.1', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000135999', 'lastCheck': '10.0', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:35:44,665::task::595::TaskManager.Task::(_updateState) Task=`d097aa0e-b6e3-4410-85a7-d60ad0c9f023`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:35:44,666::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:35:44,666::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:35:44,666::task::990::TaskManager.Task::(_decref) Task=`d097aa0e-b6e3-4410-85a7-d60ad0c9f023`::ref 0 aborting False >Thread-11647::DEBUG::2014-07-14 16:35:44,706::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:35:44,715::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000204704 s, 2.7 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:45,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:45,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0288852 s, 35.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:47,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:47,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279508 s, 36.6 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:35:47,434::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:35:47,434::task::595::TaskManager.Task::(_updateState) Task=`de4b3a4e-d7b4-437b-ae8b-9d38e4664148`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:35:47,434::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:35:47,435::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:35:47,435::task::1185::TaskManager.Task::(prepare) Task=`de4b3a4e-d7b4-437b-ae8b-9d38e4664148`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:35:47,435::task::595::TaskManager.Task::(_updateState) Task=`de4b3a4e-d7b4-437b-ae8b-9d38e4664148`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:35:47,435::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:35:47,435::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:35:47,435::task::990::TaskManager.Task::(_decref) Task=`de4b3a4e-d7b4-437b-ae8b-9d38e4664148`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:35:47,456::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:35:47,456::task::595::TaskManager.Task::(_updateState) Task=`12b7d2b3-d649-4a7d-9999-9b8b10394ac1`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:35:47,457::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:35:47,458::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`32e9ede6-50b8-4953-a4c0-2ebb5d53a6a5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:35:47,458::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:35:47,458::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:35:47,458::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`32e9ede6-50b8-4953-a4c0-2ebb5d53a6a5`::Granted request >Thread-135152::DEBUG::2014-07-14 16:35:47,459::task::827::TaskManager.Task::(resourceAcquired) Task=`12b7d2b3-d649-4a7d-9999-9b8b10394ac1`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:35:47,459::task::990::TaskManager.Task::(_decref) Task=`12b7d2b3-d649-4a7d-9999-9b8b10394ac1`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:35:47,462::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3299895934976', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:35:47,462::task::1185::TaskManager.Task::(prepare) Task=`12b7d2b3-d649-4a7d-9999-9b8b10394ac1`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3299895934976', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:35:47,462::task::595::TaskManager.Task::(_updateState) Task=`12b7d2b3-d649-4a7d-9999-9b8b10394ac1`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:35:47,462::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:35:47,462::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:35:47,463::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:35:47,463::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:35:47,463::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:35:47,463::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:35:47,463::task::990::TaskManager.Task::(_decref) Task=`12b7d2b3-d649-4a7d-9999-9b8b10394ac1`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:35:47,526::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:35:47,526::task::595::TaskManager.Task::(_updateState) Task=`c01db910-7eac-4bfc-b866-82b493f7acbf`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:35:47,526::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:35:47,527::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:35:47,527::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:35:47,527::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:35:47,527::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:35:47,527::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:35:47,527::task::1185::TaskManager.Task::(prepare) Task=`c01db910-7eac-4bfc-b866-82b493f7acbf`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:35:47,527::task::595::TaskManager.Task::(_updateState) Task=`c01db910-7eac-4bfc-b866-82b493f7acbf`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:35:47,528::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:35:47,528::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:35:47,528::task::990::TaskManager.Task::(_decref) Task=`c01db910-7eac-4bfc-b866-82b493f7acbf`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:35:49,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:49,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278055 s, 36.8 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:35:50,140::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:35:50,148::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000246127 s, 1.5 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:35:51,400::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:35:51,409::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000237446 s, 2.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:51,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:35:51,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277913 s, 36.8 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:35:52,874::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:35:52,883::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000186381 s, 3.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:53,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:35:53,618::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:35:53,630::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000194053 s, 1.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:53,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0226401 s, 45.2 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:35:54,721::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:35:54,730::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000142394 s, 3.9 MB/s\n'; <rc> = 0 >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:35:55,615::utils::697::Storage.Misc.excCmd::(watchCmd) SUCCESS: <err> = ['71680+0 records in', '71680+0 records out', '75161927680 bytes (75 GB) copied, 216.523 s, 347 MB/s']; <rc> = 0 >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:35:55,616::misc::282::Storage.Misc::(validateDDBytes) err: ['71680+0 records in', '71680+0 records out', '75161927680 bytes (75 GB) copied, 216.523 s, 347 MB/s'], size: 75161927680 >979ce810-08e8-4228-8c91-dfcf404c2a2a::INFO::2014-07-14 16:35:55,616::fileVolume::144::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/401de48b-867c-4447-939f-17e5aeca6943/cb6ffbcc-603b-41a3-8977-faafe746ef92_MERGE with size = 146800640 sectors >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:35:55,619::task::752::TaskManager.Task::(_save) Task=`979ce810-08e8-4228-8c91-dfcf404c2a2a`::_save: orig /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a temp /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a.temp >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:35:55,632::fileVolume::395::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=cb6ffbcc-603b-41a3-8977-faafe746ef92_MERGE sdUUID=965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545, metaId=('/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/401de48b-867c-4447-939f-17e5aeca6943/cb6ffbcc-603b-41a3-8977-faafe746ef92_MERGE',) >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:35:55,639::task::752::TaskManager.Task::(_save) Task=`979ce810-08e8-4228-8c91-dfcf404c2a2a`::_save: orig /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a temp /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a.temp >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:35:55,648::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for cb6ffbcc-603b-41a3-8977-faafe746ef92_MERGE >979ce810-08e8-4228-8c91-dfcf404c2a2a::INFO::2014-07-14 16:35:55,650::volume::789::Storage.Volume::(prepare) Volume: preparing volume 965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/cb6ffbcc-603b-41a3-8977-faafe746ef92_MERGE >Dummy-135145::DEBUG::2014-07-14 16:35:55,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:35:55,677::volume::1094::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/401de48b-867c-4447-939f-17e5aeca6943/cb6ffbcc-603b-41a3-8977-faafe746ef92 (qcow2) to /rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/401de48b-867c-4447-939f-17e5aeca6943/cb6ffbcc-603b-41a3-8977-faafe746ef92_MERGE (raw) START >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:35:55,681::utils::683::Storage.Misc.excCmd::(watchCmd) '/usr/bin/nice -n 19 /usr/bin/ionice -c 3 /usr/bin/qemu-img convert -t none -f qcow2 /rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/401de48b-867c-4447-939f-17e5aeca6943/cb6ffbcc-603b-41a3-8977-faafe746ef92 -O raw /rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/401de48b-867c-4447-939f-17e5aeca6943/cb6ffbcc-603b-41a3-8977-faafe746ef92_MERGE' (cwd None) >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:35:55,692::task::752::TaskManager.Task::(_save) Task=`979ce810-08e8-4228-8c91-dfcf404c2a2a`::_save: orig /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a temp /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a.temp >Dummy-135145::DEBUG::2014-07-14 16:35:55,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0646265 s, 15.8 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:35:57,688::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [2a5e3f5a] >Thread-135151::DEBUG::2014-07-14 16:35:57,689::task::595::TaskManager.Task::(_updateState) Task=`0c27fcec-efc3-4574-81e3-89d39326f45d`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:35:57,689::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:35:57,689::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:35:57,689::task::1185::TaskManager.Task::(prepare) Task=`0c27fcec-efc3-4574-81e3-89d39326f45d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:35:57,690::task::595::TaskManager.Task::(_updateState) Task=`0c27fcec-efc3-4574-81e3-89d39326f45d`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:35:57,690::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:35:57,690::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:35:57,690::task::990::TaskManager.Task::(_decref) Task=`0c27fcec-efc3-4574-81e3-89d39326f45d`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:35:57,693::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [2a5e3f5a] >Thread-135152::DEBUG::2014-07-14 16:35:57,694::task::595::TaskManager.Task::(_updateState) Task=`de20bfdd-9fe8-4700-862a-f70d130ad0e8`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:35:57,694::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:35:57,694::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`b91cdba1-e08e-4cab-a2f0-15d5ad79bf75`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:35:57,694::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:35:57,695::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:35:57,695::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`b91cdba1-e08e-4cab-a2f0-15d5ad79bf75`::Granted request >Thread-135152::DEBUG::2014-07-14 16:35:57,695::task::827::TaskManager.Task::(resourceAcquired) Task=`de20bfdd-9fe8-4700-862a-f70d130ad0e8`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:35:57,695::task::990::TaskManager.Task::(_decref) Task=`de20bfdd-9fe8-4700-862a-f70d130ad0e8`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:35:57,699::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3296406274048', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:35:57,699::task::1185::TaskManager.Task::(prepare) Task=`de20bfdd-9fe8-4700-862a-f70d130ad0e8`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3296406274048', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:35:57,700::task::595::TaskManager.Task::(_updateState) Task=`de20bfdd-9fe8-4700-862a-f70d130ad0e8`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:35:57,700::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:35:57,700::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:35:57,700::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:35:57,700::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:35:57,700::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:35:57,701::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:35:57,701::task::990::TaskManager.Task::(_decref) Task=`de20bfdd-9fe8-4700-862a-f70d130ad0e8`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:35:57,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-135151::DEBUG::2014-07-14 16:35:57,769::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:35:57,770::task::595::TaskManager.Task::(_updateState) Task=`33d9e51c-e424-446d-bdc2-39836c5c142c`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:35:57,770::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:35:57,770::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:35:57,770::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:35:57,770::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:35:57,770::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:35:57,770::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:35:57,771::task::1185::TaskManager.Task::(prepare) Task=`33d9e51c-e424-446d-bdc2-39836c5c142c`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:35:57,771::task::595::TaskManager.Task::(_updateState) Task=`33d9e51c-e424-446d-bdc2-39836c5c142c`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:35:57,771::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:35:57,771::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:35:57,771::task::990::TaskManager.Task::(_decref) Task=`33d9e51c-e424-446d-bdc2-39836c5c142c`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:35:57,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0250702 s, 40.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:35:59,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-135151::DEBUG::2014-07-14 16:35:59,833::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.05841612816 thisRx 6272668 thisTx 1941325168 samples [(1405348550.176442, 1384952368144, 1437068083880), (1405348552.191053, 1384953776756, 1437797230064), (1405348554.206052, 1384955178908, 1438511139528), (1405348556.220703, 1384957589732, 1439009405224), (1405348558.234858, 1384958640812, 1439009409048)] >Thread-135151::DEBUG::2014-07-14 16:35:59,833::task::595::TaskManager.Task::(_updateState) Task=`6aa7b3ab-3c16-4d57-9930-c8608a9db80a`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:35:59,833::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:35:59,834::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000186381', 'lastCheck': '6.9', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000237446', 'lastCheck': '8.4', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246127', 'lastCheck': '9.7', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000194053', 'lastCheck': '6.2', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000142394', 'lastCheck': '5.1', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:35:59,834::task::1185::TaskManager.Task::(prepare) Task=`6aa7b3ab-3c16-4d57-9930-c8608a9db80a`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000186381', 'lastCheck': '6.9', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000237446', 'lastCheck': '8.4', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246127', 'lastCheck': '9.7', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000194053', 'lastCheck': '6.2', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000142394', 'lastCheck': '5.1', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:35:59,834::task::595::TaskManager.Task::(_updateState) Task=`6aa7b3ab-3c16-4d57-9930-c8608a9db80a`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:35:59,835::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:35:59,835::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:35:59,835::task::990::TaskManager.Task::(_decref) Task=`6aa7b3ab-3c16-4d57-9930-c8608a9db80a`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:35:59,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279276 s, 36.7 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:36:00,154::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:36:00,162::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000240326 s, 1.5 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:36:01,539::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:36:01,549::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000318876 s, 1.7 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:01,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:01,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292501 s, 35.0 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:36:02,890::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:36:02,898::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000186624 s, 3.5 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:36:03,639::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:36:03,647::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000228642 s, 1.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:03,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:04,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367897 s, 27.8 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:36:04,737::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:36:04,746::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000239917 s, 2.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:06,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:06,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0251221 s, 40.8 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:36:07,933::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:36:07,934::task::595::TaskManager.Task::(_updateState) Task=`ea87dd52-3747-4190-922f-e5306c3a1f5e`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:36:07,934::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:36:07,934::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:36:07,935::task::1185::TaskManager.Task::(prepare) Task=`ea87dd52-3747-4190-922f-e5306c3a1f5e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:36:07,935::task::595::TaskManager.Task::(_updateState) Task=`ea87dd52-3747-4190-922f-e5306c3a1f5e`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:36:07,935::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:36:07,935::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:36:07,935::task::990::TaskManager.Task::(_decref) Task=`ea87dd52-3747-4190-922f-e5306c3a1f5e`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:36:07,939::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:36:07,939::task::595::TaskManager.Task::(_updateState) Task=`77aaf8d9-e2c1-4ebd-a794-25d955b31401`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:36:07,939::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:36:07,940::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`438455d2-33cf-4252-8ae2-936d03f2496c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:36:07,940::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:36:07,940::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:36:07,940::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`438455d2-33cf-4252-8ae2-936d03f2496c`::Granted request >Thread-135152::DEBUG::2014-07-14 16:36:07,940::task::827::TaskManager.Task::(resourceAcquired) Task=`77aaf8d9-e2c1-4ebd-a794-25d955b31401`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:36:07,941::task::990::TaskManager.Task::(_decref) Task=`77aaf8d9-e2c1-4ebd-a794-25d955b31401`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:36:07,944::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3370062446592', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:36:07,945::task::1185::TaskManager.Task::(prepare) Task=`77aaf8d9-e2c1-4ebd-a794-25d955b31401`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3370062446592', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:36:07,945::task::595::TaskManager.Task::(_updateState) Task=`77aaf8d9-e2c1-4ebd-a794-25d955b31401`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:36:07,945::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:36:07,945::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:36:07,945::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:36:07,946::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:36:07,946::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:36:07,946::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:36:07,946::task::990::TaskManager.Task::(_decref) Task=`77aaf8d9-e2c1-4ebd-a794-25d955b31401`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:36:07,997::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:36:07,997::task::595::TaskManager.Task::(_updateState) Task=`09665def-b133-43be-b13e-f8b9823003e5`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:36:07,997::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:36:07,998::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:36:07,998::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:36:07,998::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:36:07,998::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:36:07,998::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:36:07,998::task::1185::TaskManager.Task::(prepare) Task=`09665def-b133-43be-b13e-f8b9823003e5`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:36:07,999::task::595::TaskManager.Task::(_updateState) Task=`09665def-b133-43be-b13e-f8b9823003e5`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:36:07,999::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:36:07,999::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:36:07,999::task::990::TaskManager.Task::(_decref) Task=`09665def-b133-43be-b13e-f8b9823003e5`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:36:08,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:08,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364146 s, 28.1 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:36:10,168::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:36:10,177::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000267181 s, 1.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:10,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:10,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038385 s, 26.7 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:36:11,573::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:36:11,581::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000194858 s, 2.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:12,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:12,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0406863 s, 25.2 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:36:12,905::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:36:12,913::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000181232 s, 3.6 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:36:13,653::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:36:13,661::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000181091 s, 2.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:14,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:14,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364452 s, 28.1 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:36:14,753::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:36:14,762::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000269636 s, 2.1 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:36:15,003::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.09134507179 thisRx 1153626664 thisTx 1092965448 samples [(1405348566.292392, 1385657384256, 1439497892172), (1405348568.30983, 1385957988580, 1439760893488), (1405348570.327986, 1386248732868, 1440040871916), (1405348572.361125, 1386517858764, 1440307863376), (1405348574.383737, 1386811010920, 1440590857620)] >Thread-135151::DEBUG::2014-07-14 16:36:15,004::task::595::TaskManager.Task::(_updateState) Task=`f47fd7fb-c862-4865-8fc3-486daaf1a9c5`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:36:15,004::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:36:15,005::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000181232', 'lastCheck': '2.1', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000194858', 'lastCheck': '3.4', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000267181', 'lastCheck': '4.8', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000181091', 'lastCheck': '1.3', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269636', 'lastCheck': '0.2', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:36:15,005::task::1185::TaskManager.Task::(prepare) Task=`f47fd7fb-c862-4865-8fc3-486daaf1a9c5`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000181232', 'lastCheck': '2.1', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000194858', 'lastCheck': '3.4', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000267181', 'lastCheck': '4.8', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000181091', 'lastCheck': '1.3', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269636', 'lastCheck': '0.2', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:36:15,005::task::595::TaskManager.Task::(_updateState) Task=`f47fd7fb-c862-4865-8fc3-486daaf1a9c5`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:36:15,005::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:36:15,006::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:36:15,006::task::990::TaskManager.Task::(_decref) Task=`f47fd7fb-c862-4865-8fc3-486daaf1a9c5`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:36:16,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:16,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318666 s, 32.1 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:36:18,247::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:36:18,247::task::595::TaskManager.Task::(_updateState) Task=`bf444d44-f43d-44d6-86b8-f8495c75e02c`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:36:18,247::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:36:18,248::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:36:18,248::task::1185::TaskManager.Task::(prepare) Task=`bf444d44-f43d-44d6-86b8-f8495c75e02c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:36:18,248::task::595::TaskManager.Task::(_updateState) Task=`bf444d44-f43d-44d6-86b8-f8495c75e02c`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:36:18,248::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:36:18,248::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:36:18,248::task::990::TaskManager.Task::(_decref) Task=`bf444d44-f43d-44d6-86b8-f8495c75e02c`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:36:18,252::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:36:18,252::task::595::TaskManager.Task::(_updateState) Task=`939f638f-b456-42bd-ada9-3ea885fbbace`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:36:18,252::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:36:18,252::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`4459a3a2-5e6c-49ea-95ba-de02caf94ac7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:36:18,253::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:36:18,253::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:36:18,253::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`4459a3a2-5e6c-49ea-95ba-de02caf94ac7`::Granted request >Thread-135152::DEBUG::2014-07-14 16:36:18,253::task::827::TaskManager.Task::(resourceAcquired) Task=`939f638f-b456-42bd-ada9-3ea885fbbace`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:36:18,253::task::990::TaskManager.Task::(_decref) Task=`939f638f-b456-42bd-ada9-3ea885fbbace`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:36:18,256::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3368957247488', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:36:18,257::task::1185::TaskManager.Task::(prepare) Task=`939f638f-b456-42bd-ada9-3ea885fbbace`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3368957247488', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:36:18,257::task::595::TaskManager.Task::(_updateState) Task=`939f638f-b456-42bd-ada9-3ea885fbbace`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:36:18,257::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:36:18,257::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:36:18,257::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:36:18,257::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:36:18,258::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:36:18,258::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:36:18,258::task::990::TaskManager.Task::(_decref) Task=`939f638f-b456-42bd-ada9-3ea885fbbace`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:36:18,306::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [6bda814d] >Thread-135151::DEBUG::2014-07-14 16:36:18,307::task::595::TaskManager.Task::(_updateState) Task=`28fc8856-a6a7-44e0-9552-0013779674eb`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:36:18,307::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:36:18,307::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:36:18,307::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:36:18,307::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:36:18,308::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:36:18,308::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:36:18,308::task::1185::TaskManager.Task::(prepare) Task=`28fc8856-a6a7-44e0-9552-0013779674eb`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:36:18,308::task::595::TaskManager.Task::(_updateState) Task=`28fc8856-a6a7-44e0-9552-0013779674eb`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:36:18,308::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:36:18,308::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:36:18,308::task::990::TaskManager.Task::(_decref) Task=`28fc8856-a6a7-44e0-9552-0013779674eb`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:36:18,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:18,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263467 s, 38.9 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:36:20,183::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:36:20,192::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000271958 s, 1.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:20,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:20,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302261 s, 33.9 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:36:21,590::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:36:21,599::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000238264 s, 2.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:22,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:22,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279409 s, 36.6 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:36:22,922::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:36:22,930::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000194819 s, 3.3 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:36:23,666::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:36:23,678::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.00293099 s, 124 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:24,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:36:24,790::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:36:24,802::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000146485 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:24,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0667603 s, 15.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:26,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:26,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.022589 s, 45.3 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:36:28,476::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:36:28,476::task::595::TaskManager.Task::(_updateState) Task=`80c458ee-a688-435a-875d-cefc4fde5407`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:36:28,476::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:36:28,477::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:36:28,477::task::1185::TaskManager.Task::(prepare) Task=`80c458ee-a688-435a-875d-cefc4fde5407`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:36:28,477::task::595::TaskManager.Task::(_updateState) Task=`80c458ee-a688-435a-875d-cefc4fde5407`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:36:28,477::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:36:28,477::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:36:28,478::task::990::TaskManager.Task::(_decref) Task=`80c458ee-a688-435a-875d-cefc4fde5407`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:36:28,483::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:36:28,484::task::595::TaskManager.Task::(_updateState) Task=`615b49f1-9cf7-4bc0-83be-5e407770f066`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:36:28,484::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:36:28,484::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`3cf333f0-2623-4bd9-b9e9-a8e76236246a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:36:28,484::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:36:28,485::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:36:28,485::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`3cf333f0-2623-4bd9-b9e9-a8e76236246a`::Granted request >Thread-135152::DEBUG::2014-07-14 16:36:28,485::task::827::TaskManager.Task::(resourceAcquired) Task=`615b49f1-9cf7-4bc0-83be-5e407770f066`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:36:28,485::task::990::TaskManager.Task::(_decref) Task=`615b49f1-9cf7-4bc0-83be-5e407770f066`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:36:28,489::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3367637090304', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:36:28,489::task::1185::TaskManager.Task::(prepare) Task=`615b49f1-9cf7-4bc0-83be-5e407770f066`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3367637090304', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:36:28,490::task::595::TaskManager.Task::(_updateState) Task=`615b49f1-9cf7-4bc0-83be-5e407770f066`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:36:28,490::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:36:28,490::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:36:28,490::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:36:28,490::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:36:28,490::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:36:28,491::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:36:28,491::task::990::TaskManager.Task::(_decref) Task=`615b49f1-9cf7-4bc0-83be-5e407770f066`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:36:28,604::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:36:28,605::task::595::TaskManager.Task::(_updateState) Task=`07d914e5-f568-4c57-9299-2d68080d0f58`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:36:28,605::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:36:28,605::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:36:28,605::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:36:28,606::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:36:28,606::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:36:28,606::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:36:28,606::task::1185::TaskManager.Task::(prepare) Task=`07d914e5-f568-4c57-9299-2d68080d0f58`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:36:28,606::task::595::TaskManager.Task::(_updateState) Task=`07d914e5-f568-4c57-9299-2d68080d0f58`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:36:28,606::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:36:28,607::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:36:28,607::task::990::TaskManager.Task::(_decref) Task=`07d914e5-f568-4c57-9299-2d68080d0f58`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:36:28,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:28,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272897 s, 37.5 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:36:30,174::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.06493401527 thisRx 1118058894 thisTx 1083751604 samples [(1405348580.438103, 1387628250064, 1441406212412), (1405348582.454639, 1387898402968, 1441670417468), (1405348584.47241, 1388197951110, 1441959618148), (1405348586.487361, 1388475973550, 1442225312888), (1405348588.503037, 1388746308958, 1442489964016)] >Thread-135151::DEBUG::2014-07-14 16:36:30,175::task::595::TaskManager.Task::(_updateState) Task=`fe5d7f63-0199-44b8-9f3e-1a3d60c58b50`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:36:30,175::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:36:30,175::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000194819', 'lastCheck': '7.2', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000238264', 'lastCheck': '8.6', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271958', 'lastCheck': '10.0', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00293099', 'lastCheck': '6.5', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000146485', 'lastCheck': '5.4', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:36:30,176::task::1185::TaskManager.Task::(prepare) Task=`fe5d7f63-0199-44b8-9f3e-1a3d60c58b50`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000194819', 'lastCheck': '7.2', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000238264', 'lastCheck': '8.6', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271958', 'lastCheck': '10.0', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00293099', 'lastCheck': '6.5', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000146485', 'lastCheck': '5.4', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:36:30,176::task::595::TaskManager.Task::(_updateState) Task=`fe5d7f63-0199-44b8-9f3e-1a3d60c58b50`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:36:30,176::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:36:30,176::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:36:30,176::task::990::TaskManager.Task::(_decref) Task=`fe5d7f63-0199-44b8-9f3e-1a3d60c58b50`::ref 0 aborting False >Thread-11635::DEBUG::2014-07-14 16:36:30,197::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:36:30,205::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000140134 s, 2.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:30,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:31,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028176 s, 36.3 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:36:31,608::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:36:31,619::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000249933 s, 2.2 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:36:32,937::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:36:32,946::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000196963 s, 3.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:33,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:33,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276119 s, 37.1 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:36:33,684::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:36:33,694::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.00201089 s, 181 kB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:36:34,819::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:36:34,832::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00326505 s, 171 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:35,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:35,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0283194 s, 36.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:37,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:37,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0225851 s, 45.3 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:36:38,719::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [1e74e3f3] >Thread-135151::DEBUG::2014-07-14 16:36:38,720::task::595::TaskManager.Task::(_updateState) Task=`66e04601-b381-4867-87e9-6a64533352fa`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:36:38,720::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:36:38,720::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:36:38,721::task::1185::TaskManager.Task::(prepare) Task=`66e04601-b381-4867-87e9-6a64533352fa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:36:38,721::task::595::TaskManager.Task::(_updateState) Task=`66e04601-b381-4867-87e9-6a64533352fa`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:36:38,721::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:36:38,721::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:36:38,721::task::990::TaskManager.Task::(_decref) Task=`66e04601-b381-4867-87e9-6a64533352fa`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:36:38,725::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [1e74e3f3] >Thread-135152::DEBUG::2014-07-14 16:36:38,725::task::595::TaskManager.Task::(_updateState) Task=`9fe964c8-db5b-4380-a5fd-3ed79588a23d`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:36:38,726::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:36:38,726::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`ca761cb1-b9b4-48ce-977c-3c927312d9dd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:36:38,726::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:36:38,726::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:36:38,726::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`ca761cb1-b9b4-48ce-977c-3c927312d9dd`::Granted request >Thread-135152::DEBUG::2014-07-14 16:36:38,727::task::827::TaskManager.Task::(resourceAcquired) Task=`9fe964c8-db5b-4380-a5fd-3ed79588a23d`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:36:38,727::task::990::TaskManager.Task::(_decref) Task=`9fe964c8-db5b-4380-a5fd-3ed79588a23d`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:36:38,730::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3366353633280', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:36:38,730::task::1185::TaskManager.Task::(prepare) Task=`9fe964c8-db5b-4380-a5fd-3ed79588a23d`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3366353633280', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:36:38,730::task::595::TaskManager.Task::(_updateState) Task=`9fe964c8-db5b-4380-a5fd-3ed79588a23d`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:36:38,730::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:36:38,731::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:36:38,731::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:36:38,731::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:36:38,731::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:36:38,731::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:36:38,731::task::990::TaskManager.Task::(_decref) Task=`9fe964c8-db5b-4380-a5fd-3ed79588a23d`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:36:38,794::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:36:38,794::task::595::TaskManager.Task::(_updateState) Task=`f3532160-5d9b-4a77-9542-c920a821b347`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:36:38,794::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:36:38,794::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:36:38,795::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:36:38,795::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:36:38,795::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:36:38,795::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:36:38,795::task::1185::TaskManager.Task::(prepare) Task=`f3532160-5d9b-4a77-9542-c920a821b347`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:36:38,795::task::595::TaskManager.Task::(_updateState) Task=`f3532160-5d9b-4a77-9542-c920a821b347`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:36:38,795::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:36:38,796::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:36:38,796::task::990::TaskManager.Task::(_decref) Task=`f3532160-5d9b-4a77-9542-c920a821b347`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:36:39,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:39,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277092 s, 37.0 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:36:40,210::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:36:40,219::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000206097 s, 1.7 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:41,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:41,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282622 s, 36.2 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:36:41,625::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:36:41,634::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000395449 s, 1.4 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:36:42,954::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:36:42,963::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000174185 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:43,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:43,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027586 s, 37.1 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:36:43,701::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:36:43,712::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000833417 s, 436 kB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:36:44,838::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:36:44,847::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000241407 s, 2.3 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:36:45,361::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.07204508781 thisRx 1091874680 thisTx 1077250448 samples [(1405348596.574148, 1389844528136, 1443567475984), (1405348598.595628, 1390119081324, 1443839284576), (1405348600.612712, 1390399087568, 1444108046100), (1405348602.630305, 1390661828484, 1444376449764), (1405348604.646193, 1390936402816, 1444644726432)] >Thread-135151::DEBUG::2014-07-14 16:36:45,362::task::595::TaskManager.Task::(_updateState) Task=`72722a59-5d63-46d8-ad8b-fe0f021a06aa`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:36:45,362::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:36:45,363::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000174185', 'lastCheck': '2.4', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395449', 'lastCheck': '3.7', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000206097', 'lastCheck': '5.1', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000833417', 'lastCheck': '1.6', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000241407', 'lastCheck': '0.5', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:36:45,363::task::1185::TaskManager.Task::(prepare) Task=`72722a59-5d63-46d8-ad8b-fe0f021a06aa`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000174185', 'lastCheck': '2.4', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395449', 'lastCheck': '3.7', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000206097', 'lastCheck': '5.1', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000833417', 'lastCheck': '1.6', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000241407', 'lastCheck': '0.5', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:36:45,363::task::595::TaskManager.Task::(_updateState) Task=`72722a59-5d63-46d8-ad8b-fe0f021a06aa`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:36:45,363::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:36:45,363::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:36:45,364::task::990::TaskManager.Task::(_decref) Task=`72722a59-5d63-46d8-ad8b-fe0f021a06aa`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:36:45,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:45,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029071 s, 35.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:47,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:47,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.025 s, 41.0 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:36:48,947::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:36:48,947::task::595::TaskManager.Task::(_updateState) Task=`1242f6bb-ba23-41f8-8828-40bec1f108a7`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:36:48,948::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:36:48,948::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:36:48,948::task::1185::TaskManager.Task::(prepare) Task=`1242f6bb-ba23-41f8-8828-40bec1f108a7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:36:48,948::task::595::TaskManager.Task::(_updateState) Task=`1242f6bb-ba23-41f8-8828-40bec1f108a7`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:36:48,949::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:36:48,949::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:36:48,949::task::990::TaskManager.Task::(_decref) Task=`1242f6bb-ba23-41f8-8828-40bec1f108a7`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:36:48,953::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:36:48,953::task::595::TaskManager.Task::(_updateState) Task=`a5416bd9-c2c3-4f68-a93f-38c0abbbe231`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:36:48,953::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:36:48,954::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`221d5090-ff8b-4c9d-8d05-f6de65ddb69d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:36:48,954::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:36:48,954::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:36:48,954::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`221d5090-ff8b-4c9d-8d05-f6de65ddb69d`::Granted request >Thread-135152::DEBUG::2014-07-14 16:36:48,955::task::827::TaskManager.Task::(resourceAcquired) Task=`a5416bd9-c2c3-4f68-a93f-38c0abbbe231`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:36:48,955::task::990::TaskManager.Task::(_decref) Task=`a5416bd9-c2c3-4f68-a93f-38c0abbbe231`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:36:48,959::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3365045010432', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:36:48,959::task::1185::TaskManager.Task::(prepare) Task=`a5416bd9-c2c3-4f68-a93f-38c0abbbe231`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3365045010432', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:36:48,959::task::595::TaskManager.Task::(_updateState) Task=`a5416bd9-c2c3-4f68-a93f-38c0abbbe231`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:36:48,959::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:36:48,959::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:36:48,960::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:36:48,960::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:36:48,960::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:36:48,960::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:36:48,961::task::990::TaskManager.Task::(_decref) Task=`a5416bd9-c2c3-4f68-a93f-38c0abbbe231`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:36:49,016::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:36:49,016::task::595::TaskManager.Task::(_updateState) Task=`7f4c838b-8887-436b-b6b5-1ed89dbc8e03`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:36:49,016::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:36:49,016::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:36:49,017::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:36:49,017::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:36:49,017::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:36:49,017::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:36:49,017::task::1185::TaskManager.Task::(prepare) Task=`7f4c838b-8887-436b-b6b5-1ed89dbc8e03`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:36:49,018::task::595::TaskManager.Task::(_updateState) Task=`7f4c838b-8887-436b-b6b5-1ed89dbc8e03`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:36:49,018::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:36:49,018::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:36:49,018::task::990::TaskManager.Task::(_decref) Task=`7f4c838b-8887-436b-b6b5-1ed89dbc8e03`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:36:49,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:49,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296762 s, 34.5 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:36:50,224::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:36:50,232::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000188472 s, 1.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:51,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:36:51,643::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:36:51,654::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000187369 s, 3.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:51,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0433504 s, 23.6 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:36:52,970::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:36:52,978::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000244067 s, 2.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:53,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:36:53,725::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:36:53,735::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000221327 s, 1.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:53,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.042373 s, 24.2 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:36:54,854::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:36:54,863::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.0002539 s, 2.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:55,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:55,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292392 s, 35.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:36:57,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:57,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.022946 s, 44.6 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:36:59,121::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:36:59,121::task::595::TaskManager.Task::(_updateState) Task=`09156220-3f2f-4b6f-ac45-e282c06e161f`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:36:59,121::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:36:59,122::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:36:59,122::task::1185::TaskManager.Task::(prepare) Task=`09156220-3f2f-4b6f-ac45-e282c06e161f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:36:59,122::task::595::TaskManager.Task::(_updateState) Task=`09156220-3f2f-4b6f-ac45-e282c06e161f`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:36:59,122::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:36:59,122::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:36:59,123::task::990::TaskManager.Task::(_decref) Task=`09156220-3f2f-4b6f-ac45-e282c06e161f`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:36:59,126::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:36:59,126::task::595::TaskManager.Task::(_updateState) Task=`b0f4472b-07ea-479b-84c7-eef0590f0681`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:36:59,127::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:36:59,127::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`7b94336c-702e-40da-9c2a-f2389b04ee93`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:36:59,128::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:36:59,128::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:36:59,128::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`7b94336c-702e-40da-9c2a-f2389b04ee93`::Granted request >Thread-135152::DEBUG::2014-07-14 16:36:59,128::task::827::TaskManager.Task::(resourceAcquired) Task=`b0f4472b-07ea-479b-84c7-eef0590f0681`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:36:59,129::task::990::TaskManager.Task::(_decref) Task=`b0f4472b-07ea-479b-84c7-eef0590f0681`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:36:59,132::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3363755261952', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:36:59,132::task::1185::TaskManager.Task::(prepare) Task=`b0f4472b-07ea-479b-84c7-eef0590f0681`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3363755261952', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:36:59,133::task::595::TaskManager.Task::(_updateState) Task=`b0f4472b-07ea-479b-84c7-eef0590f0681`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:36:59,133::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:36:59,133::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:36:59,133::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:36:59,133::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:36:59,134::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:36:59,134::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:36:59,134::task::990::TaskManager.Task::(_decref) Task=`b0f4472b-07ea-479b-84c7-eef0590f0681`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:36:59,188::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:36:59,188::task::595::TaskManager.Task::(_updateState) Task=`8cbe926f-6e7b-4fc7-be1b-b7c9c2165f3c`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:36:59,189::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:36:59,189::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:36:59,189::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:36:59,189::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:36:59,189::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:36:59,189::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:36:59,190::task::1185::TaskManager.Task::(prepare) Task=`8cbe926f-6e7b-4fc7-be1b-b7c9c2165f3c`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:36:59,190::task::595::TaskManager.Task::(_updateState) Task=`8cbe926f-6e7b-4fc7-be1b-b7c9c2165f3c`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:36:59,190::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:36:59,190::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:36:59,190::task::990::TaskManager.Task::(_decref) Task=`8cbe926f-6e7b-4fc7-be1b-b7c9c2165f3c`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:36:59,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:36:59,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0225947 s, 45.3 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:37:00,238::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:37:00,246::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000235554 s, 1.5 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:37:00,628::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.0676150322 thisRx 1126075948 thisTx 1105948224 samples [(1405348610.69858, 1391765480820, 1445450568848), (1405348612.715374, 1392048555904, 1445729484124), (1405348614.73534, 1392324346556, 1446002308080), (1405348616.751269, 1392598712496, 1446272992092), (1405348618.766195, 1392891556768, 1446556517072)] >Thread-135151::DEBUG::2014-07-14 16:37:00,629::task::595::TaskManager.Task::(_updateState) Task=`97c0adb0-f05e-4149-bdb0-1805ec0f35cb`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:37:00,629::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:37:00,630::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000244067', 'lastCheck': '7.6', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000187369', 'lastCheck': '9.0', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000235554', 'lastCheck': '0.4', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000221327', 'lastCheck': '6.9', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0002539', 'lastCheck': '5.8', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:37:00,630::task::1185::TaskManager.Task::(prepare) Task=`97c0adb0-f05e-4149-bdb0-1805ec0f35cb`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000244067', 'lastCheck': '7.6', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000187369', 'lastCheck': '9.0', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000235554', 'lastCheck': '0.4', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000221327', 'lastCheck': '6.9', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0002539', 'lastCheck': '5.8', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:37:00,630::task::595::TaskManager.Task::(_updateState) Task=`97c0adb0-f05e-4149-bdb0-1805ec0f35cb`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:37:00,630::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:37:00,630::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:37:00,631::task::990::TaskManager.Task::(_decref) Task=`97c0adb0-f05e-4149-bdb0-1805ec0f35cb`::ref 0 aborting False >Thread-11634::DEBUG::2014-07-14 16:37:01,726::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:37:01,737::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000305946 s, 1.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:01,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:02,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281653 s, 36.4 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:37:02,986::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:37:02,994::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000199696 s, 3.2 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:37:03,745::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:37:03,753::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000182562 s, 2.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:04,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:04,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277954 s, 36.8 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:37:04,876::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:37:04,885::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000333795 s, 1.7 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:06,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:06,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0222842 s, 46.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:08,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:08,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277643 s, 36.9 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:37:09,333::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [3f0bb9a1] >Thread-135151::DEBUG::2014-07-14 16:37:09,333::task::595::TaskManager.Task::(_updateState) Task=`0a970f3f-b8c0-4348-857f-77b1db3cb801`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:37:09,334::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:37:09,334::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:37:09,334::task::1185::TaskManager.Task::(prepare) Task=`0a970f3f-b8c0-4348-857f-77b1db3cb801`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:37:09,334::task::595::TaskManager.Task::(_updateState) Task=`0a970f3f-b8c0-4348-857f-77b1db3cb801`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:37:09,334::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:37:09,334::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:37:09,335::task::990::TaskManager.Task::(_decref) Task=`0a970f3f-b8c0-4348-857f-77b1db3cb801`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:37:09,339::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [3f0bb9a1] >Thread-135152::DEBUG::2014-07-14 16:37:09,339::task::595::TaskManager.Task::(_updateState) Task=`7063cc8b-1aea-428e-bcd6-cebc0f4257a9`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:37:09,339::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:37:09,340::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`444447f6-de66-4dc3-9495-60d45c0d2d02`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:37:09,340::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:37:09,340::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:37:09,340::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`444447f6-de66-4dc3-9495-60d45c0d2d02`::Granted request >Thread-135152::DEBUG::2014-07-14 16:37:09,341::task::827::TaskManager.Task::(resourceAcquired) Task=`7063cc8b-1aea-428e-bcd6-cebc0f4257a9`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:37:09,341::task::990::TaskManager.Task::(_decref) Task=`7063cc8b-1aea-428e-bcd6-cebc0f4257a9`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:37:09,344::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3362465513472', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:37:09,344::task::1185::TaskManager.Task::(prepare) Task=`7063cc8b-1aea-428e-bcd6-cebc0f4257a9`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3362465513472', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:37:09,344::task::595::TaskManager.Task::(_updateState) Task=`7063cc8b-1aea-428e-bcd6-cebc0f4257a9`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:37:09,344::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:37:09,344::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:37:09,345::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:37:09,345::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:37:09,345::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:37:09,345::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:37:09,345::task::990::TaskManager.Task::(_decref) Task=`7063cc8b-1aea-428e-bcd6-cebc0f4257a9`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:37:09,406::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:37:09,407::task::595::TaskManager.Task::(_updateState) Task=`5a3c9db2-74c0-485a-82bf-83aad58b5aab`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:37:09,407::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:37:09,408::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:37:09,408::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:37:09,408::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:37:09,408::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:37:09,408::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:37:09,408::task::1185::TaskManager.Task::(prepare) Task=`5a3c9db2-74c0-485a-82bf-83aad58b5aab`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:37:09,409::task::595::TaskManager.Task::(_updateState) Task=`5a3c9db2-74c0-485a-82bf-83aad58b5aab`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:37:09,409::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:37:09,409::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:37:09,409::task::990::TaskManager.Task::(_decref) Task=`5a3c9db2-74c0-485a-82bf-83aad58b5aab`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:37:10,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:37:10,267::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:37:10,278::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000159942 s, 2.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:10,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.054476 s, 18.8 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:37:11,754::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:37:11,767::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000231682 s, 2.4 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:12,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:12,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278337 s, 36.8 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:37:13,004::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:37:13,012::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000234374 s, 2.7 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:37:13,759::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:37:13,767::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000184385 s, 2.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:14,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:14,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0531915 s, 19.3 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:37:14,893::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:37:14,906::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000207168 s, 2.7 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:37:15,797::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.08727312088 thisRx 1121517564 thisTx 1097174940 samples [(1405348626.829975, 1393968334028, 1447612873952), (1405348628.849152, 1394237225864, 1447868142880), (1405348630.863485, 1394522360732, 1448154916808), (1405348632.8787, 1394814089436, 1448442835808), (1405348634.917248, 1395089851592, 1448710048892)] >Thread-135151::DEBUG::2014-07-14 16:37:15,797::task::595::TaskManager.Task::(_updateState) Task=`ad81aff0-e03e-4930-86b9-d91ca7119914`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:37:15,799::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:37:15,800::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000234374', 'lastCheck': '2.8', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000231682', 'lastCheck': '4.0', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000159942', 'lastCheck': '5.5', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000184385', 'lastCheck': '2.0', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000207168', 'lastCheck': '0.9', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:37:15,800::task::1185::TaskManager.Task::(prepare) Task=`ad81aff0-e03e-4930-86b9-d91ca7119914`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000234374', 'lastCheck': '2.8', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000231682', 'lastCheck': '4.0', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000159942', 'lastCheck': '5.5', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000184385', 'lastCheck': '2.0', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000207168', 'lastCheck': '0.9', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:37:15,800::task::595::TaskManager.Task::(_updateState) Task=`ad81aff0-e03e-4930-86b9-d91ca7119914`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:37:15,800::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:37:15,800::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:37:15,800::task::990::TaskManager.Task::(_decref) Task=`ad81aff0-e03e-4930-86b9-d91ca7119914`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:37:16,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:16,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328186 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:18,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:18,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343419 s, 29.8 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:37:19,570::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:37:19,571::task::595::TaskManager.Task::(_updateState) Task=`0cd1326d-5ae3-4b46-8e7f-dbaa3197645c`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:37:19,571::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:37:19,572::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:37:19,572::task::1185::TaskManager.Task::(prepare) Task=`0cd1326d-5ae3-4b46-8e7f-dbaa3197645c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:37:19,572::task::595::TaskManager.Task::(_updateState) Task=`0cd1326d-5ae3-4b46-8e7f-dbaa3197645c`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:37:19,572::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:37:19,572::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:37:19,572::task::990::TaskManager.Task::(_decref) Task=`0cd1326d-5ae3-4b46-8e7f-dbaa3197645c`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:37:19,576::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:37:19,577::task::595::TaskManager.Task::(_updateState) Task=`214ad166-b065-4298-9a52-c10609d373a6`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:37:19,577::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:37:19,577::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`6e3503ac-fb46-444a-ae17-e428ea124f29`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:37:19,578::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:37:19,578::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:37:19,578::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`6e3503ac-fb46-444a-ae17-e428ea124f29`::Granted request >Thread-135152::DEBUG::2014-07-14 16:37:19,578::task::827::TaskManager.Task::(resourceAcquired) Task=`214ad166-b065-4298-9a52-c10609d373a6`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:37:19,578::task::990::TaskManager.Task::(_decref) Task=`214ad166-b065-4298-9a52-c10609d373a6`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:37:19,582::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3361143259136', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:37:19,582::task::1185::TaskManager.Task::(prepare) Task=`214ad166-b065-4298-9a52-c10609d373a6`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3361143259136', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:37:19,583::task::595::TaskManager.Task::(_updateState) Task=`214ad166-b065-4298-9a52-c10609d373a6`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:37:19,583::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:37:19,583::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:37:19,583::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:37:19,583::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:37:19,584::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:37:19,584::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:37:19,584::task::990::TaskManager.Task::(_decref) Task=`214ad166-b065-4298-9a52-c10609d373a6`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:37:19,647::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:37:19,648::task::595::TaskManager.Task::(_updateState) Task=`0716c3fd-72c7-4e6e-b850-fa95d99d1d9f`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:37:19,648::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:37:19,648::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:37:19,648::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:37:19,649::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:37:19,649::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:37:19,649::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:37:19,649::task::1185::TaskManager.Task::(prepare) Task=`0716c3fd-72c7-4e6e-b850-fa95d99d1d9f`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:37:19,649::task::595::TaskManager.Task::(_updateState) Task=`0716c3fd-72c7-4e6e-b850-fa95d99d1d9f`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:37:19,649::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:37:19,650::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:37:19,650::task::990::TaskManager.Task::(_decref) Task=`0716c3fd-72c7-4e6e-b850-fa95d99d1d9f`::ref 0 aborting False >Thread-11635::DEBUG::2014-07-14 16:37:20,286::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:37:20,295::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000136425 s, 2.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:20,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:20,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385237 s, 26.6 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:37:21,780::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:37:21,793::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000178041 s, 3.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:22,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:22,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293386 s, 34.9 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:37:23,020::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:37:23,028::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000224841 s, 2.9 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:37:23,773::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:37:23,782::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000524807 s, 692 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:24,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:24,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285292 s, 35.9 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:37:24,920::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:37:24,929::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000171816 s, 3.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:26,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:26,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0255751 s, 40.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:28,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:29,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0283802 s, 36.1 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:37:29,799::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:37:29,799::task::595::TaskManager.Task::(_updateState) Task=`a670e4aa-ca21-4a2f-8e88-47a505e7a2a8`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:37:29,799::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:37:29,800::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:37:29,800::task::1185::TaskManager.Task::(prepare) Task=`a670e4aa-ca21-4a2f-8e88-47a505e7a2a8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:37:29,800::task::595::TaskManager.Task::(_updateState) Task=`a670e4aa-ca21-4a2f-8e88-47a505e7a2a8`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:37:29,802::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:37:29,802::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:37:29,802::task::990::TaskManager.Task::(_decref) Task=`a670e4aa-ca21-4a2f-8e88-47a505e7a2a8`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:37:29,807::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:37:29,808::task::595::TaskManager.Task::(_updateState) Task=`71437eb8-1400-45bf-9771-a2e6923f29cd`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:37:29,808::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:37:29,808::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`35677413-421c-4811-9d57-75614982375d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:37:29,808::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:37:29,809::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:37:29,809::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`35677413-421c-4811-9d57-75614982375d`::Granted request >Thread-135152::DEBUG::2014-07-14 16:37:29,809::task::827::TaskManager.Task::(resourceAcquired) Task=`71437eb8-1400-45bf-9771-a2e6923f29cd`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:37:29,809::task::990::TaskManager.Task::(_decref) Task=`71437eb8-1400-45bf-9771-a2e6923f29cd`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:37:29,813::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3359817859072', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:37:29,814::task::1185::TaskManager.Task::(prepare) Task=`71437eb8-1400-45bf-9771-a2e6923f29cd`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3359817859072', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:37:29,814::task::595::TaskManager.Task::(_updateState) Task=`71437eb8-1400-45bf-9771-a2e6923f29cd`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:37:29,814::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:37:29,814::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:37:29,814::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:37:29,815::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:37:29,815::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:37:29,815::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:37:29,815::task::990::TaskManager.Task::(_decref) Task=`71437eb8-1400-45bf-9771-a2e6923f29cd`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:37:29,895::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:37:29,896::task::595::TaskManager.Task::(_updateState) Task=`e49b8687-95ca-4ada-a753-e023babeb9c1`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:37:29,896::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:37:29,896::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:37:29,896::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:37:29,896::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:37:29,897::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:37:29,897::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:37:29,897::task::1185::TaskManager.Task::(prepare) Task=`e49b8687-95ca-4ada-a753-e023babeb9c1`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:37:29,897::task::595::TaskManager.Task::(_updateState) Task=`e49b8687-95ca-4ada-a753-e023babeb9c1`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:37:29,897::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:37:29,897::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:37:29,898::task::990::TaskManager.Task::(_decref) Task=`e49b8687-95ca-4ada-a753-e023babeb9c1`::ref 0 aborting False >Thread-11635::DEBUG::2014-07-14 16:37:30,300::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:37:30,309::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000162231 s, 2.2 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:37:30,969::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.07552099228 thisRx 1125390448 thisTx 1098475080 samples [(1405348640.97198, 1395939500280, 1449548144724), (1405348642.994901, 1396216245420, 1449812442420), (1405348645.014107, 1396504829924, 1450089964112), (1405348647.028586, 1396785984368, 1450368964288), (1405348649.047501, 1397064890728, 1450646619804)] >Thread-135151::DEBUG::2014-07-14 16:37:30,970::task::595::TaskManager.Task::(_updateState) Task=`7a5f4aba-3cba-460c-9d35-678badd36ad0`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:37:30,970::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:37:30,971::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000224841', 'lastCheck': '7.9', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000178041', 'lastCheck': '9.2', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000162231', 'lastCheck': '0.7', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524807', 'lastCheck': '7.2', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000171816', 'lastCheck': '6.0', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:37:30,971::task::1185::TaskManager.Task::(prepare) Task=`7a5f4aba-3cba-460c-9d35-678badd36ad0`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000224841', 'lastCheck': '7.9', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000178041', 'lastCheck': '9.2', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000162231', 'lastCheck': '0.7', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524807', 'lastCheck': '7.2', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000171816', 'lastCheck': '6.0', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:37:30,971::task::595::TaskManager.Task::(_updateState) Task=`7a5f4aba-3cba-460c-9d35-678badd36ad0`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:37:30,971::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:37:30,971::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:37:30,971::task::990::TaskManager.Task::(_decref) Task=`7a5f4aba-3cba-460c-9d35-678badd36ad0`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:37:31,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:31,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.205244 s, 5.0 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:37:31,815::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:37:31,826::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000134288 s, 4.1 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:37:33,035::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:37:33,044::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000177045 s, 3.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:33,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:33,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282937 s, 36.2 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:37:33,792::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:37:33,802::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000222741 s, 1.6 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:37:34,935::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:37:34,951::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00580963 s, 95.9 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:35,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:35,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275142 s, 37.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:37,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:37,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0254161 s, 40.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:39,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:39,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0253266 s, 40.4 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:37:40,055::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [41ff59cc] >Thread-135151::DEBUG::2014-07-14 16:37:40,056::task::595::TaskManager.Task::(_updateState) Task=`57eb236c-914f-4d7c-a293-c66d0ddfdc01`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:37:40,056::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:37:40,056::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:37:40,057::task::1185::TaskManager.Task::(prepare) Task=`57eb236c-914f-4d7c-a293-c66d0ddfdc01`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:37:40,057::task::595::TaskManager.Task::(_updateState) Task=`57eb236c-914f-4d7c-a293-c66d0ddfdc01`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:37:40,057::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:37:40,057::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:37:40,057::task::990::TaskManager.Task::(_decref) Task=`57eb236c-914f-4d7c-a293-c66d0ddfdc01`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:37:40,061::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [41ff59cc] >Thread-135152::DEBUG::2014-07-14 16:37:40,061::task::595::TaskManager.Task::(_updateState) Task=`6d613caa-7d33-44e0-8c03-0ba77e01bff6`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:37:40,062::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:37:40,062::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`f7e951cb-dc02-4bd8-90ef-8bea2b62d97d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:37:40,062::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:37:40,063::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:37:40,063::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`f7e951cb-dc02-4bd8-90ef-8bea2b62d97d`::Granted request >Thread-135152::DEBUG::2014-07-14 16:37:40,063::task::827::TaskManager.Task::(resourceAcquired) Task=`6d613caa-7d33-44e0-8c03-0ba77e01bff6`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:37:40,063::task::990::TaskManager.Task::(_decref) Task=`6d613caa-7d33-44e0-8c03-0ba77e01bff6`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:37:40,067::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3358480924672', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:37:40,067::task::1185::TaskManager.Task::(prepare) Task=`6d613caa-7d33-44e0-8c03-0ba77e01bff6`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3358480924672', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:37:40,067::task::595::TaskManager.Task::(_updateState) Task=`6d613caa-7d33-44e0-8c03-0ba77e01bff6`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:37:40,067::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:37:40,068::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:37:40,068::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:37:40,068::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:37:40,068::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:37:40,068::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:37:40,069::task::990::TaskManager.Task::(_decref) Task=`6d613caa-7d33-44e0-8c03-0ba77e01bff6`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:37:40,215::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:37:40,215::task::595::TaskManager.Task::(_updateState) Task=`ef59b01a-a86c-47f2-99cf-89729fc1b73c`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:37:40,215::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:37:40,215::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:37:40,216::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:37:40,216::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:37:40,216::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:37:40,216::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:37:40,216::task::1185::TaskManager.Task::(prepare) Task=`ef59b01a-a86c-47f2-99cf-89729fc1b73c`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:37:40,216::task::595::TaskManager.Task::(_updateState) Task=`ef59b01a-a86c-47f2-99cf-89729fc1b73c`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:37:40,217::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:37:40,217::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:37:40,217::task::990::TaskManager.Task::(_decref) Task=`ef59b01a-a86c-47f2-99cf-89729fc1b73c`::ref 0 aborting False >Thread-11635::DEBUG::2014-07-14 16:37:40,314::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:37:40,323::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000234439 s, 1.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:41,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:41,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0251125 s, 40.8 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:37:41,838::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:37:41,851::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000189818 s, 2.9 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:37:43,051::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2c51d320-88ce-4f23-8215-e15f55f66906 >Thread-11633::DEBUG::2014-07-14 16:37:43,065::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906 >Thread-11633::DEBUG::2014-07-14 16:37:43,066::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-11633::DEBUG::2014-07-14 16:37:43,068::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=colnas03_IB', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=Collogia', 'POOL_DOMAINS=272ec473-6041-42ee-bd1a-732789dd18d4:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=8', 'POOL_UUID=94ed7a19-fade-4bd6-83f2-2cbb2f730b95', 'REMOTE_PATH=10.10.30.253:/var/nas3/OVirtIB', 'ROLE=Master', 'SDUUID=2c51d320-88ce-4f23-8215-e15f55f66906', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=7829fcdff1769c5cc605544bf5c48fb68b8d48a6'] >Thread-11633::DEBUG::2014-07-14 16:37:43,069::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-11633::INFO::2014-07-14 16:37:43,069::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2c51d320-88ce-4f23-8215-e15f55f66906_imageNS already registered >Thread-11633::INFO::2014-07-14 16:37:43,070::sd::391::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2c51d320-88ce-4f23-8215-e15f55f66906_volumeNS already registered >Thread-11633::DEBUG::2014-07-14 16:37:43,073::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:37:43,082::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000228661 s, 2.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:43,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:43,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027624 s, 37.1 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:37:43,808::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:37:43,816::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000200324 s, 1.8 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:37:44,959::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:37:44,968::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000126592 s, 4.4 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:45,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:45,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277838 s, 36.9 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:37:46,147::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.06859993935 thisRx 1085629480 thisTx 1066411968 samples [(1405348657.150871, 1398219523836, 1451783910056), (1405348659.166682, 1398497197176, 1452055598940), (1405348661.185495, 1398788065924, 1452337772940), (1405348663.201303, 1399067157032, 1452609829596), (1405348665.219471, 1399305153316, 1452850322024)] >Thread-135151::DEBUG::2014-07-14 16:37:46,148::task::595::TaskManager.Task::(_updateState) Task=`99b51c48-f696-4155-8977-8bc3ba11d316`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:37:46,148::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:37:46,148::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000228661', 'lastCheck': '3.1', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000189818', 'lastCheck': '4.3', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000234439', 'lastCheck': '5.8', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000200324', 'lastCheck': '2.3', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000126592', 'lastCheck': '1.2', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:37:46,149::task::1185::TaskManager.Task::(prepare) Task=`99b51c48-f696-4155-8977-8bc3ba11d316`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000228661', 'lastCheck': '3.1', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000189818', 'lastCheck': '4.3', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000234439', 'lastCheck': '5.8', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000200324', 'lastCheck': '2.3', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000126592', 'lastCheck': '1.2', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:37:46,149::task::595::TaskManager.Task::(_updateState) Task=`99b51c48-f696-4155-8977-8bc3ba11d316`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:37:46,149::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:37:46,149::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:37:46,149::task::990::TaskManager.Task::(_decref) Task=`99b51c48-f696-4155-8977-8bc3ba11d316`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:37:47,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:47,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0219841 s, 46.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:49,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:49,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303609 s, 33.7 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:37:50,330::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-135151::DEBUG::2014-07-14 16:37:50,340::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [44abe31] >Thread-11635::DEBUG::2014-07-14 16:37:50,342::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000256731 s, 1.4 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:37:50,342::task::595::TaskManager.Task::(_updateState) Task=`2b16aa27-3703-4cd2-a800-e8a5e1323c47`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:37:50,344::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:37:50,344::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:37:50,345::task::1185::TaskManager.Task::(prepare) Task=`2b16aa27-3703-4cd2-a800-e8a5e1323c47`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:37:50,347::task::595::TaskManager.Task::(_updateState) Task=`2b16aa27-3703-4cd2-a800-e8a5e1323c47`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:37:50,347::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:37:50,347::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:37:50,347::task::990::TaskManager.Task::(_decref) Task=`2b16aa27-3703-4cd2-a800-e8a5e1323c47`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:37:50,351::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [44abe31] >Thread-135152::DEBUG::2014-07-14 16:37:50,352::task::595::TaskManager.Task::(_updateState) Task=`6a3aaf73-0b81-4840-815a-15e976a85727`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:37:50,352::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:37:50,352::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`03c12f45-765e-4971-925b-d0867c052b9b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:37:50,353::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:37:50,353::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:37:50,353::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`03c12f45-765e-4971-925b-d0867c052b9b`::Granted request >Thread-135152::DEBUG::2014-07-14 16:37:50,353::task::827::TaskManager.Task::(resourceAcquired) Task=`6a3aaf73-0b81-4840-815a-15e976a85727`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:37:50,354::task::990::TaskManager.Task::(_decref) Task=`6a3aaf73-0b81-4840-815a-15e976a85727`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:37:50,357::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3357124067328', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:37:50,358::task::1185::TaskManager.Task::(prepare) Task=`6a3aaf73-0b81-4840-815a-15e976a85727`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3357124067328', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:37:50,358::task::595::TaskManager.Task::(_updateState) Task=`6a3aaf73-0b81-4840-815a-15e976a85727`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:37:50,358::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:37:50,358::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:37:50,358::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:37:50,359::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:37:50,359::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:37:50,359::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:37:50,359::task::990::TaskManager.Task::(_decref) Task=`6a3aaf73-0b81-4840-815a-15e976a85727`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:37:50,448::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:37:50,449::task::595::TaskManager.Task::(_updateState) Task=`fdc41cc1-2375-485a-9b5b-9c6b2a143aa9`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:37:50,449::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:37:50,449::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:37:50,449::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:37:50,450::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:37:50,450::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:37:50,450::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:37:50,450::task::1185::TaskManager.Task::(prepare) Task=`fdc41cc1-2375-485a-9b5b-9c6b2a143aa9`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:37:50,450::task::595::TaskManager.Task::(_updateState) Task=`fdc41cc1-2375-485a-9b5b-9c6b2a143aa9`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:37:50,451::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:37:50,451::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:37:50,451::task::990::TaskManager.Task::(_decref) Task=`fdc41cc1-2375-485a-9b5b-9c6b2a143aa9`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:37:51,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:51,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0254862 s, 40.2 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:37:51,908::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:37:51,924::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00191861 s, 290 kB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:37:53,090::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:37:53,098::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000163203 s, 3.9 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:37:53,821::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:37:53,829::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000256042 s, 1.4 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:53,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:53,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279405 s, 36.6 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:37:54,974::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:37:54,982::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000225855 s, 2.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:55,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:56,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263527 s, 38.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:37:58,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:37:58,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245367 s, 41.7 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:00,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:00,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296397 s, 34.5 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:38:00,351::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:38:00,360::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000216742 s, 1.6 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:38:00,601::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:38:00,602::task::595::TaskManager.Task::(_updateState) Task=`45fcaa48-c492-4592-987d-72f9b1a41261`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:38:00,602::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:38:00,602::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:38:00,603::task::1185::TaskManager.Task::(prepare) Task=`45fcaa48-c492-4592-987d-72f9b1a41261`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:38:00,603::task::595::TaskManager.Task::(_updateState) Task=`45fcaa48-c492-4592-987d-72f9b1a41261`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:38:00,603::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:38:00,603::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:38:00,603::task::990::TaskManager.Task::(_decref) Task=`45fcaa48-c492-4592-987d-72f9b1a41261`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:38:00,607::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:38:00,608::task::595::TaskManager.Task::(_updateState) Task=`3740d1b4-61d2-409b-bbc6-986fc92e4165`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:38:00,608::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:38:00,608::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`61640e73-f7d3-43be-8a4e-8e17f06ee2ad`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:38:00,609::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:38:00,609::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:38:00,609::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`61640e73-f7d3-43be-8a4e-8e17f06ee2ad`::Granted request >Thread-135152::DEBUG::2014-07-14 16:38:00,609::task::827::TaskManager.Task::(resourceAcquired) Task=`3740d1b4-61d2-409b-bbc6-986fc92e4165`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:38:00,610::task::990::TaskManager.Task::(_decref) Task=`3740d1b4-61d2-409b-bbc6-986fc92e4165`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:38:00,613::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3355898281984', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:38:00,614::task::1185::TaskManager.Task::(prepare) Task=`3740d1b4-61d2-409b-bbc6-986fc92e4165`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3355898281984', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:38:00,614::task::595::TaskManager.Task::(_updateState) Task=`3740d1b4-61d2-409b-bbc6-986fc92e4165`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:38:00,614::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:38:00,614::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:38:00,614::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:38:00,615::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:38:00,615::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:38:00,615::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:38:00,615::task::990::TaskManager.Task::(_decref) Task=`3740d1b4-61d2-409b-bbc6-986fc92e4165`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:38:00,694::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:38:00,695::task::595::TaskManager.Task::(_updateState) Task=`ae2586ba-df57-4f36-a1d0-438092e4d1d0`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:38:00,695::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:38:00,695::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:38:00,696::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:38:00,696::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:38:00,696::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:38:00,696::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:38:00,696::task::1185::TaskManager.Task::(prepare) Task=`ae2586ba-df57-4f36-a1d0-438092e4d1d0`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:38:00,696::task::595::TaskManager.Task::(_updateState) Task=`ae2586ba-df57-4f36-a1d0-438092e4d1d0`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:38:00,697::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:38:00,697::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:38:00,697::task::990::TaskManager.Task::(_decref) Task=`ae2586ba-df57-4f36-a1d0-438092e4d1d0`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:38:01,301::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.0667450428 thisRx 1075715404 thisTx 1069076324 samples [(1405348671.284571, 1400095490220, 1453629259620), (1405348673.301948, 1400344216884, 1453876386088), (1405348675.319517, 1400632859464, 1454154629832), (1405348677.335747, 1400908599072, 1454437796492), (1405348679.351316, 1401171205624, 1454698335944)] >Thread-135151::DEBUG::2014-07-14 16:38:01,305::task::595::TaskManager.Task::(_updateState) Task=`62a12f64-2d17-4165-b71d-ac0d7617c93b`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:38:01,306::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:38:01,308::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000163203', 'lastCheck': '8.2', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00191861', 'lastCheck': '9.4', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000216742', 'lastCheck': '0.9', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000256042', 'lastCheck': '7.5', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000225855', 'lastCheck': '6.3', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:38:01,309::task::1185::TaskManager.Task::(prepare) Task=`62a12f64-2d17-4165-b71d-ac0d7617c93b`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000163203', 'lastCheck': '8.2', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00191861', 'lastCheck': '9.4', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000216742', 'lastCheck': '0.9', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000256042', 'lastCheck': '7.5', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000225855', 'lastCheck': '6.3', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:38:01,310::task::595::TaskManager.Task::(_updateState) Task=`62a12f64-2d17-4165-b71d-ac0d7617c93b`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:38:01,311::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:38:01,312::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:38:01,313::task::990::TaskManager.Task::(_decref) Task=`62a12f64-2d17-4165-b71d-ac0d7617c93b`::ref 0 aborting False >Thread-11634::DEBUG::2014-07-14 16:38:01,981::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:38:02,001::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00735127 s, 75.8 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:02,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:02,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286284 s, 35.8 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:38:03,106::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:38:03,115::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000324308 s, 2.0 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:38:03,835::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:38:03,844::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000160764 s, 2.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:04,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:04,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265997 s, 38.5 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:38:04,990::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:38:04,999::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000183088 s, 3.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:06,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:06,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0232504 s, 44.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:08,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:08,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026581 s, 38.5 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:38:10,366::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:38:10,374::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000202736 s, 1.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:10,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:10,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303825 s, 33.7 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:38:10,861::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:38:10,862::task::595::TaskManager.Task::(_updateState) Task=`9821bde4-3cb5-4a94-8ccb-d21a9aadbef7`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:38:10,862::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:38:10,862::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:38:10,863::task::1185::TaskManager.Task::(prepare) Task=`9821bde4-3cb5-4a94-8ccb-d21a9aadbef7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:38:10,863::task::595::TaskManager.Task::(_updateState) Task=`9821bde4-3cb5-4a94-8ccb-d21a9aadbef7`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:38:10,863::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:38:10,863::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:38:10,863::task::990::TaskManager.Task::(_decref) Task=`9821bde4-3cb5-4a94-8ccb-d21a9aadbef7`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:38:10,868::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:38:10,868::task::595::TaskManager.Task::(_updateState) Task=`a3307ef6-654e-4e84-9aa7-cdb5f9eab24c`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:38:10,868::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:38:10,869::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`2d54b3cb-97ee-4891-bb4d-8d5305722b77`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:38:10,869::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:38:10,869::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:38:10,869::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`2d54b3cb-97ee-4891-bb4d-8d5305722b77`::Granted request >Thread-135152::DEBUG::2014-07-14 16:38:10,870::task::827::TaskManager.Task::(resourceAcquired) Task=`a3307ef6-654e-4e84-9aa7-cdb5f9eab24c`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:38:10,870::task::990::TaskManager.Task::(_decref) Task=`a3307ef6-654e-4e84-9aa7-cdb5f9eab24c`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:38:10,873::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3354601193472', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:38:10,874::task::1185::TaskManager.Task::(prepare) Task=`a3307ef6-654e-4e84-9aa7-cdb5f9eab24c`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3354601193472', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:38:10,874::task::595::TaskManager.Task::(_updateState) Task=`a3307ef6-654e-4e84-9aa7-cdb5f9eab24c`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:38:10,874::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:38:10,874::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:38:10,874::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:38:10,875::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:38:10,875::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:38:10,875::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:38:10,875::task::990::TaskManager.Task::(_decref) Task=`a3307ef6-654e-4e84-9aa7-cdb5f9eab24c`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:38:10,956::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [41ff59cc] >Thread-135151::DEBUG::2014-07-14 16:38:10,957::task::595::TaskManager.Task::(_updateState) Task=`0e53251a-0149-4d92-8bd4-453cd828f96f`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:38:10,957::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:38:10,957::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:38:10,957::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:38:10,957::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:38:10,957::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:38:10,958::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:38:10,958::task::1185::TaskManager.Task::(prepare) Task=`0e53251a-0149-4d92-8bd4-453cd828f96f`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:38:10,958::task::595::TaskManager.Task::(_updateState) Task=`0e53251a-0149-4d92-8bd4-453cd828f96f`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:38:10,958::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:38:10,958::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:38:10,958::task::990::TaskManager.Task::(_decref) Task=`0e53251a-0149-4d92-8bd4-453cd828f96f`::ref 0 aborting False >Thread-11634::DEBUG::2014-07-14 16:38:12,025::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:38:12,044::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000192307 s, 2.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:12,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:12,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271297 s, 37.7 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:38:13,123::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:38:13,131::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000232568 s, 2.8 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:38:13,852::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:38:13,860::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000166261 s, 2.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:14,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:14,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245052 s, 41.8 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:38:15,006::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:38:15,016::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.0018742 s, 297 kB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:38:16,516::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.07011818886 thisRx 1130988248 thisTx 1106396576 samples [(1405348687.412701, 1402284722320, 1455790036420), (1405348689.431673, 1402556164756, 1456059306684), (1405348691.448354, 1402840600276, 1456330462692), (1405348693.46294, 1403125984628, 1456618816476), (1405348695.482819, 1403415710568, 1456896432996)] >Thread-135151::DEBUG::2014-07-14 16:38:16,518::task::595::TaskManager.Task::(_updateState) Task=`7c98eacd-035c-4529-b6aa-e274e75fabd8`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:38:16,518::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:38:16,518::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000232568', 'lastCheck': '3.4', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000192307', 'lastCheck': '4.5', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000202736', 'lastCheck': '6.1', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000166261', 'lastCheck': '2.7', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0018742', 'lastCheck': '1.5', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:38:16,519::task::1185::TaskManager.Task::(prepare) Task=`7c98eacd-035c-4529-b6aa-e274e75fabd8`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000232568', 'lastCheck': '3.4', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000192307', 'lastCheck': '4.5', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000202736', 'lastCheck': '6.1', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000166261', 'lastCheck': '2.7', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0018742', 'lastCheck': '1.5', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:38:16,519::task::595::TaskManager.Task::(_updateState) Task=`7c98eacd-035c-4529-b6aa-e274e75fabd8`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:38:16,519::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:38:16,519::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:38:16,520::task::990::TaskManager.Task::(_decref) Task=`7c98eacd-035c-4529-b6aa-e274e75fabd8`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:38:16,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:16,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293961 s, 34.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:18,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:18,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0216783 s, 47.2 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:38:20,380::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:38:20,389::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000286641 s, 1.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:20,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:20,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028885 s, 35.5 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:38:21,170::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:38:21,171::task::595::TaskManager.Task::(_updateState) Task=`8a42cc6e-4dfb-4560-8b81-bd85ea37f7fb`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:38:21,171::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:38:21,171::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:38:21,172::task::1185::TaskManager.Task::(prepare) Task=`8a42cc6e-4dfb-4560-8b81-bd85ea37f7fb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:38:21,172::task::595::TaskManager.Task::(_updateState) Task=`8a42cc6e-4dfb-4560-8b81-bd85ea37f7fb`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:38:21,172::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:38:21,172::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:38:21,172::task::990::TaskManager.Task::(_decref) Task=`8a42cc6e-4dfb-4560-8b81-bd85ea37f7fb`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:38:21,176::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:38:21,176::task::595::TaskManager.Task::(_updateState) Task=`b3c4d2fb-9287-48bd-8507-42074fc9ee8b`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:38:21,176::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:38:21,177::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`fb76fdbb-6683-4a5f-8767-fa7e187de4ac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:38:21,177::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:38:21,177::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:38:21,177::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`fb76fdbb-6683-4a5f-8767-fa7e187de4ac`::Granted request >Thread-135152::DEBUG::2014-07-14 16:38:21,178::task::827::TaskManager.Task::(resourceAcquired) Task=`b3c4d2fb-9287-48bd-8507-42074fc9ee8b`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:38:21,178::task::990::TaskManager.Task::(_decref) Task=`b3c4d2fb-9287-48bd-8507-42074fc9ee8b`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:38:21,181::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3353273696256', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:38:21,182::task::1185::TaskManager.Task::(prepare) Task=`b3c4d2fb-9287-48bd-8507-42074fc9ee8b`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3353273696256', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:38:21,182::task::595::TaskManager.Task::(_updateState) Task=`b3c4d2fb-9287-48bd-8507-42074fc9ee8b`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:38:21,182::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:38:21,182::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:38:21,183::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:38:21,183::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:38:21,183::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:38:21,183::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:38:21,184::task::990::TaskManager.Task::(_decref) Task=`b3c4d2fb-9287-48bd-8507-42074fc9ee8b`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:38:21,240::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [e0e7e60] >Thread-135151::DEBUG::2014-07-14 16:38:21,241::task::595::TaskManager.Task::(_updateState) Task=`74a391f6-d3bc-4125-abb3-4e2fec74459a`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:38:21,241::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:38:21,241::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:38:21,241::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:38:21,241::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:38:21,241::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:38:21,242::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:38:21,242::task::1185::TaskManager.Task::(prepare) Task=`74a391f6-d3bc-4125-abb3-4e2fec74459a`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:38:21,242::task::595::TaskManager.Task::(_updateState) Task=`74a391f6-d3bc-4125-abb3-4e2fec74459a`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:38:21,242::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:38:21,242::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:38:21,242::task::990::TaskManager.Task::(_decref) Task=`74a391f6-d3bc-4125-abb3-4e2fec74459a`::ref 0 aborting False >Thread-11634::DEBUG::2014-07-14 16:38:22,061::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:38:22,069::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000156772 s, 3.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:22,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:22,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273676 s, 37.4 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:38:23,139::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:38:23,148::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000184724 s, 3.5 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:38:23,865::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:38:23,874::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000150297 s, 2.4 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:24,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:24,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0417254 s, 24.5 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:38:25,028::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:38:25,037::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00017943 s, 3.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:27,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:27,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0222949 s, 45.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:29,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:29,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282106 s, 36.3 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:38:30,391::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain bff3a2be-fdd9-4e37-b416-fa4ef7fafba2 >Thread-11635::DEBUG::2014-07-14 16:38:30,407::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2 >Thread-11635::DEBUG::2014-07-14 16:38:30,408::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-11635::DEBUG::2014-07-14 16:38:30,410::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=colnas03_ISO', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=94ed7a19-fade-4bd6-83f2-2cbb2f730b95', 'REMOTE_PATH=10.10.30.253:/var/nas3/OVirtISO', 'ROLE=Regular', 'SDUUID=bff3a2be-fdd9-4e37-b416-fa4ef7fafba2', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=c50201e21217b2f429ff30bead20d9af06fab3f0'] >Thread-11635::DEBUG::2014-07-14 16:38:30,412::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-11635::INFO::2014-07-14 16:38:30,412::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace bff3a2be-fdd9-4e37-b416-fa4ef7fafba2_imageNS already registered >Thread-11635::INFO::2014-07-14 16:38:30,412::sd::391::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace bff3a2be-fdd9-4e37-b416-fa4ef7fafba2_volumeNS already registered >Thread-11635::DEBUG::2014-07-14 16:38:30,417::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:38:30,426::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000191543 s, 1.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:31,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:31,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279108 s, 36.7 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:38:31,386::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:38:31,387::task::595::TaskManager.Task::(_updateState) Task=`61d76be8-7148-4cca-bd91-f03db2dba9f6`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:38:31,387::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:38:31,387::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:38:31,388::task::1185::TaskManager.Task::(prepare) Task=`61d76be8-7148-4cca-bd91-f03db2dba9f6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:38:31,388::task::595::TaskManager.Task::(_updateState) Task=`61d76be8-7148-4cca-bd91-f03db2dba9f6`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:38:31,388::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:38:31,388::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:38:31,388::task::990::TaskManager.Task::(_decref) Task=`61d76be8-7148-4cca-bd91-f03db2dba9f6`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:38:31,392::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:38:31,392::task::595::TaskManager.Task::(_updateState) Task=`438abb9f-ce3c-4db2-893f-4c988bfc8fda`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:38:31,392::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:38:31,393::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`20563e9b-b1b6-4a81-84ae-342fdec83e23`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:38:31,393::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:38:31,393::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:38:31,393::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`20563e9b-b1b6-4a81-84ae-342fdec83e23`::Granted request >Thread-135152::DEBUG::2014-07-14 16:38:31,394::task::827::TaskManager.Task::(resourceAcquired) Task=`438abb9f-ce3c-4db2-893f-4c988bfc8fda`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:38:31,394::task::990::TaskManager.Task::(_decref) Task=`438abb9f-ce3c-4db2-893f-4c988bfc8fda`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:38:31,398::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3351926276096', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:38:31,398::task::1185::TaskManager.Task::(prepare) Task=`438abb9f-ce3c-4db2-893f-4c988bfc8fda`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3351926276096', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:38:31,398::task::595::TaskManager.Task::(_updateState) Task=`438abb9f-ce3c-4db2-893f-4c988bfc8fda`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:38:31,398::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:38:31,398::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:38:31,399::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:38:31,399::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:38:31,399::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:38:31,399::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:38:31,399::task::990::TaskManager.Task::(_decref) Task=`438abb9f-ce3c-4db2-893f-4c988bfc8fda`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:38:31,485::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:38:31,485::task::595::TaskManager.Task::(_updateState) Task=`46edf0a3-e186-46b1-a35d-5d6dae919fd5`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:38:31,485::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:38:31,486::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:38:31,486::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:38:31,486::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:38:31,486::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:38:31,486::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:38:31,486::task::1185::TaskManager.Task::(prepare) Task=`46edf0a3-e186-46b1-a35d-5d6dae919fd5`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:38:31,487::task::595::TaskManager.Task::(_updateState) Task=`46edf0a3-e186-46b1-a35d-5d6dae919fd5`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:38:31,487::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:38:31,487::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:38:31,487::task::990::TaskManager.Task::(_decref) Task=`46edf0a3-e186-46b1-a35d-5d6dae919fd5`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:38:31,703::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.07172513008 thisRx 1189313788 thisTx 1168890220 samples [(1405348703.550947, 1404511901804, 1457971998932), (1405348705.567078, 1404804964628, 1458269106452), (1405348707.586234, 1405097957436, 1458555260988), (1405348709.604694, 1405387105056, 1458828562484), (1405348711.622672, 1405701215592, 1459140889152)] >Thread-135151::DEBUG::2014-07-14 16:38:31,704::task::595::TaskManager.Task::(_updateState) Task=`c69a685f-500a-423c-9323-b0900d6fa564`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:38:31,704::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:38:31,705::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000184724', 'lastCheck': '8.6', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000156772', 'lastCheck': '9.6', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000191543', 'lastCheck': '1.3', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000150297', 'lastCheck': '7.8', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00017943', 'lastCheck': '6.7', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:38:31,705::task::1185::TaskManager.Task::(prepare) Task=`c69a685f-500a-423c-9323-b0900d6fa564`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000184724', 'lastCheck': '8.6', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000156772', 'lastCheck': '9.6', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000191543', 'lastCheck': '1.3', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000150297', 'lastCheck': '7.8', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00017943', 'lastCheck': '6.7', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:38:31,705::task::595::TaskManager.Task::(_updateState) Task=`c69a685f-500a-423c-9323-b0900d6fa564`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:38:31,705::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:38:31,705::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:38:31,705::task::990::TaskManager.Task::(_decref) Task=`c69a685f-500a-423c-9323-b0900d6fa564`::ref 0 aborting False >Thread-11634::DEBUG::2014-07-14 16:38:32,079::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:38:32,090::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000228889 s, 2.4 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:38:33,154::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:38:33,163::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000226236 s, 2.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:33,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:33,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278476 s, 36.8 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:38:33,880::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:38:33,888::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000184776 s, 2.0 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:38:35,044::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:38:35,059::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000173417 s, 3.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:35,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:35,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316792 s, 32.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:37,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:37,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0250485 s, 40.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:39,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:39,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0227918 s, 44.9 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:38:40,433::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:38:40,441::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000240454 s, 1.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:41,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:41,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0734257 s, 13.9 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:38:41,641::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:38:41,641::task::595::TaskManager.Task::(_updateState) Task=`dc2c2366-baf1-4621-a5d8-6baf69a43918`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:38:41,641::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:38:41,642::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:38:41,642::task::1185::TaskManager.Task::(prepare) Task=`dc2c2366-baf1-4621-a5d8-6baf69a43918`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:38:41,642::task::595::TaskManager.Task::(_updateState) Task=`dc2c2366-baf1-4621-a5d8-6baf69a43918`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:38:41,642::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:38:41,642::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:38:41,643::task::990::TaskManager.Task::(_decref) Task=`dc2c2366-baf1-4621-a5d8-6baf69a43918`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:38:41,646::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:38:41,646::task::595::TaskManager.Task::(_updateState) Task=`3d3af1f0-1eef-495b-b4aa-152721e22f63`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:38:41,646::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:38:41,647::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`673200be-8295-4121-bfaa-f81b8f9676ed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:38:41,647::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:38:41,647::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:38:41,647::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`673200be-8295-4121-bfaa-f81b8f9676ed`::Granted request >Thread-135152::DEBUG::2014-07-14 16:38:41,648::task::827::TaskManager.Task::(resourceAcquired) Task=`3d3af1f0-1eef-495b-b4aa-152721e22f63`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:38:41,648::task::990::TaskManager.Task::(_decref) Task=`3d3af1f0-1eef-495b-b4aa-152721e22f63`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:38:41,651::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3350575710208', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:38:41,651::task::1185::TaskManager.Task::(prepare) Task=`3d3af1f0-1eef-495b-b4aa-152721e22f63`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3350575710208', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:38:41,651::task::595::TaskManager.Task::(_updateState) Task=`3d3af1f0-1eef-495b-b4aa-152721e22f63`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:38:41,651::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:38:41,652::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:38:41,652::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:38:41,652::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:38:41,652::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:38:41,652::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:38:41,653::task::990::TaskManager.Task::(_decref) Task=`3d3af1f0-1eef-495b-b4aa-152721e22f63`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:38:41,748::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:38:41,749::task::595::TaskManager.Task::(_updateState) Task=`c5942124-49a2-47c7-a0d8-e6eba797c431`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:38:41,749::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:38:41,749::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:38:41,749::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:38:41,749::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:38:41,749::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:38:41,750::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:38:41,750::task::1185::TaskManager.Task::(prepare) Task=`c5942124-49a2-47c7-a0d8-e6eba797c431`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:38:41,750::task::595::TaskManager.Task::(_updateState) Task=`c5942124-49a2-47c7-a0d8-e6eba797c431`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:38:41,750::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:38:41,750::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:38:41,750::task::990::TaskManager.Task::(_decref) Task=`c5942124-49a2-47c7-a0d8-e6eba797c431`::ref 0 aborting False >Thread-11634::DEBUG::2014-07-14 16:38:42,098::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:38:42,152::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000180433 s, 3.1 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:38:43,171::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:38:43,179::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000240364 s, 2.7 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:43,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:43,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291145 s, 35.2 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:38:43,898::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:38:43,907::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000142366 s, 2.5 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:38:45,065::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:38:45,073::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000176402 s, 3.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:45,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:45,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282018 s, 36.3 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:38:46,858::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.06203603745 thisRx 1191273368 thisTx 1163495088 samples [(1405348717.670153, 1406509082860, 1459939211096), (1405348719.68747, 1406793395712, 1460218922624), (1405348721.703346, 1407070153080, 1460494294924), (1405348723.717337, 1407396286144, 1460801907268), (1405348725.732189, 1407700356228, 1461102706184)] >Thread-135151::DEBUG::2014-07-14 16:38:46,858::task::595::TaskManager.Task::(_updateState) Task=`95f46439-c978-4fde-99a2-9ac03b32b1a3`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:38:46,859::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:38:46,859::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000240364', 'lastCheck': '3.7', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000180433', 'lastCheck': '4.7', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000240454', 'lastCheck': '6.4', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000142366', 'lastCheck': '3.0', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000176402', 'lastCheck': '1.8', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:38:46,859::task::1185::TaskManager.Task::(prepare) Task=`95f46439-c978-4fde-99a2-9ac03b32b1a3`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000240364', 'lastCheck': '3.7', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000180433', 'lastCheck': '4.7', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000240454', 'lastCheck': '6.4', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000142366', 'lastCheck': '3.0', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000176402', 'lastCheck': '1.8', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:38:46,859::task::595::TaskManager.Task::(_updateState) Task=`95f46439-c978-4fde-99a2-9ac03b32b1a3`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:38:46,860::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:38:46,860::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:38:46,860::task::990::TaskManager.Task::(_decref) Task=`95f46439-c978-4fde-99a2-9ac03b32b1a3`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:38:47,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:47,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350058 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:49,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:49,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0283383 s, 36.1 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:38:50,447::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:38:50,462::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.00551074 s, 64.8 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:51,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-135151::DEBUG::2014-07-14 16:38:51,924::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:38:51,926::task::595::TaskManager.Task::(_updateState) Task=`d5078b85-97f0-4817-abee-1d8d947985de`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:38:51,928::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:38:51,930::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:38:51,931::task::1185::TaskManager.Task::(prepare) Task=`d5078b85-97f0-4817-abee-1d8d947985de`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:38:51,932::task::595::TaskManager.Task::(_updateState) Task=`d5078b85-97f0-4817-abee-1d8d947985de`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:38:51,933::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:38:51,934::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:38:51,936::task::990::TaskManager.Task::(_decref) Task=`d5078b85-97f0-4817-abee-1d8d947985de`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:38:51,943::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:38:51,945::task::595::TaskManager.Task::(_updateState) Task=`0564cc4d-e687-47b3-ac78-4b5609ef6887`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:38:51,946::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:38:51,949::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`b9e1697a-6b40-4b96-a4f7-b51e6fdf7e91`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:38:51,950::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:38:51,951::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:38:51,952::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`b9e1697a-6b40-4b96-a4f7-b51e6fdf7e91`::Granted request >Thread-135152::DEBUG::2014-07-14 16:38:51,955::task::827::TaskManager.Task::(resourceAcquired) Task=`0564cc4d-e687-47b3-ac78-4b5609ef6887`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:38:51,956::task::990::TaskManager.Task::(_decref) Task=`0564cc4d-e687-47b3-ac78-4b5609ef6887`::ref 1 aborting False >Dummy-135145::DEBUG::2014-07-14 16:38:51,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0251369 s, 40.7 MB/s\n'; <rc> = 0 >Thread-135152::INFO::2014-07-14 16:38:51,981::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3349269184512', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:38:51,982::task::1185::TaskManager.Task::(prepare) Task=`0564cc4d-e687-47b3-ac78-4b5609ef6887`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3349269184512', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:38:51,983::task::595::TaskManager.Task::(_updateState) Task=`0564cc4d-e687-47b3-ac78-4b5609ef6887`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:38:51,984::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:38:51,985::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:38:51,986::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:38:51,987::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:38:51,988::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:38:51,989::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:38:51,990::task::990::TaskManager.Task::(_decref) Task=`0564cc4d-e687-47b3-ac78-4b5609ef6887`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:38:52,094::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:38:52,094::task::595::TaskManager.Task::(_updateState) Task=`fb133070-fd71-4ae0-a037-0d1f647e1f10`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:38:52,095::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:38:52,095::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:38:52,095::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:38:52,095::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:38:52,095::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:38:52,095::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:38:52,096::task::1185::TaskManager.Task::(prepare) Task=`fb133070-fd71-4ae0-a037-0d1f647e1f10`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:38:52,096::task::595::TaskManager.Task::(_updateState) Task=`fb133070-fd71-4ae0-a037-0d1f647e1f10`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:38:52,096::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:38:52,096::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:38:52,096::task::990::TaskManager.Task::(_decref) Task=`fb133070-fd71-4ae0-a037-0d1f647e1f10`::ref 0 aborting False >Thread-11634::DEBUG::2014-07-14 16:38:52,197::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:38:52,225::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00414463 s, 134 kB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:38:53,189::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:38:53,207::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000226072 s, 2.8 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:38:53,909::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 63041fa9-e093-4b44-b36f-f39f16d3974f >Thread-11641::DEBUG::2014-07-14 16:38:53,916::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f >Thread-11641::DEBUG::2014-07-14 16:38:53,918::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-11641::DEBUG::2014-07-14 16:38:53,920::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=colnas03_EXPORT', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=94ed7a19-fade-4bd6-83f2-2cbb2f730b95', 'REMOTE_PATH=10.10.30.253:/var/nas3/OVirtEXP', 'ROLE=Regular', 'SDUUID=63041fa9-e093-4b44-b36f-f39f16d3974f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=05042021c79752349f1701a69f9049b70f993176'] >Thread-11641::DEBUG::2014-07-14 16:38:53,921::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-11641::INFO::2014-07-14 16:38:53,921::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 63041fa9-e093-4b44-b36f-f39f16d3974f_imageNS already registered >Thread-11641::INFO::2014-07-14 16:38:53,921::sd::391::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 63041fa9-e093-4b44-b36f-f39f16d3974f_volumeNS already registered >Thread-11641::DEBUG::2014-07-14 16:38:53,925::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:38:53,941::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000222106 s, 1.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:54,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:54,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029415 s, 34.8 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:38:55,080::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:38:55,103::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000227174 s, 2.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:56,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:56,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273568 s, 37.4 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:38:58,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:38:58,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286375 s, 35.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:00,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:00,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241062 s, 42.5 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:39:00,468::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:39:00,477::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000207721 s, 1.7 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:39:02,021::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.05690908432 thisRx 1096124032 thisTx 1088561928 samples [(1405348733.802165, 1408841446668, 1462221700176), (1405348735.817344, 1409121324668, 1462505783128), (1405348737.831281, 1409390373936, 1462766108272), (1405348739.84494, 1409669008080, 1463040556572), (1405348741.859074, 1409937570700, 1463310262104)] >Thread-135151::DEBUG::2014-07-14 16:39:02,022::task::595::TaskManager.Task::(_updateState) Task=`005f24d6-076f-4435-a266-295a4bf3d918`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:39:02,022::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:39:02,023::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000226072', 'lastCheck': '8.8', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00414463', 'lastCheck': '9.8', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000207721', 'lastCheck': '1.5', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000222106', 'lastCheck': '8.1', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000227174', 'lastCheck': '6.9', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:39:02,023::task::1185::TaskManager.Task::(prepare) Task=`005f24d6-076f-4435-a266-295a4bf3d918`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000226072', 'lastCheck': '8.8', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00414463', 'lastCheck': '9.8', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000207721', 'lastCheck': '1.5', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000222106', 'lastCheck': '8.1', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000227174', 'lastCheck': '6.9', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:39:02,023::task::595::TaskManager.Task::(_updateState) Task=`005f24d6-076f-4435-a266-295a4bf3d918`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:39:02,023::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:39:02,023::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:39:02,024::task::990::TaskManager.Task::(_decref) Task=`005f24d6-076f-4435-a266-295a4bf3d918`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:39:02,215::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:39:02,215::task::595::TaskManager.Task::(_updateState) Task=`3b5b0861-13ee-4b63-b6ef-76dd595e170a`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:39:02,215::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:39:02,216::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:39:02,216::task::1185::TaskManager.Task::(prepare) Task=`3b5b0861-13ee-4b63-b6ef-76dd595e170a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:39:02,216::task::595::TaskManager.Task::(_updateState) Task=`3b5b0861-13ee-4b63-b6ef-76dd595e170a`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:39:02,216::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:39:02,216::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:39:02,216::task::990::TaskManager.Task::(_decref) Task=`3b5b0861-13ee-4b63-b6ef-76dd595e170a`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:39:02,220::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:39:02,220::task::595::TaskManager.Task::(_updateState) Task=`b32f15df-705a-4d5b-8ce4-907c17df8898`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:39:02,220::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:39:02,221::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`39aef52c-f988-47a1-a427-272534db369f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:39:02,221::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:39:02,221::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:39:02,221::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`39aef52c-f988-47a1-a427-272534db369f`::Granted request >Thread-135152::DEBUG::2014-07-14 16:39:02,222::task::827::TaskManager.Task::(resourceAcquired) Task=`b32f15df-705a-4d5b-8ce4-907c17df8898`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:39:02,222::task::990::TaskManager.Task::(_decref) Task=`b32f15df-705a-4d5b-8ce4-907c17df8898`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:39:02,225::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3347870384128', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:39:02,226::task::1185::TaskManager.Task::(prepare) Task=`b32f15df-705a-4d5b-8ce4-907c17df8898`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3347870384128', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:39:02,226::task::595::TaskManager.Task::(_updateState) Task=`b32f15df-705a-4d5b-8ce4-907c17df8898`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:39:02,226::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:39:02,226::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:39:02,226::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:39:02,227::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:39:02,227::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:39:02,227::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:39:02,227::task::990::TaskManager.Task::(_decref) Task=`b32f15df-705a-4d5b-8ce4-907c17df8898`::ref 0 aborting False >Thread-11634::DEBUG::2014-07-14 16:39:02,271::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:02,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-135151::DEBUG::2014-07-14 16:39:02,327::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:39:02,339::task::595::TaskManager.Task::(_updateState) Task=`f4070ba8-bc8f-4626-8f83-a55fb580e5ff`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:39:02,341::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-11634::DEBUG::2014-07-14 16:39:02,341::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.0117647 s, 47.3 kB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:39:02,343::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:39:02,344::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:39:02,345::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:39:02,346::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:39:02,348::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:39:02,349::task::1185::TaskManager.Task::(prepare) Task=`f4070ba8-bc8f-4626-8f83-a55fb580e5ff`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:39:02,350::task::595::TaskManager.Task::(_updateState) Task=`f4070ba8-bc8f-4626-8f83-a55fb580e5ff`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:39:02,351::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:39:02,352::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:39:02,353::task::990::TaskManager.Task::(_decref) Task=`f4070ba8-bc8f-4626-8f83-a55fb580e5ff`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:39:02,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452846 s, 22.6 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:39:03,215::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:39:03,233::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.00151932 s, 424 kB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:39:03,947::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:39:03,979::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000129433 s, 2.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:04,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:04,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280179 s, 36.5 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:39:05,109::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:39:05,131::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000234689 s, 2.4 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:06,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:06,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0210678 s, 48.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:08,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:08,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0288899 s, 35.4 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:39:10,483::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:39:10,495::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000347841 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:10,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:10,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326107 s, 31.4 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:39:12,385::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:39:12,449::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000174867 s, 3.2 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:39:12,464::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:39:12,465::task::595::TaskManager.Task::(_updateState) Task=`fd9462ef-eb51-4a58-bbed-7f78dfb39a25`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:39:12,465::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:39:12,466::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:39:12,466::task::1185::TaskManager.Task::(prepare) Task=`fd9462ef-eb51-4a58-bbed-7f78dfb39a25`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:39:12,466::task::595::TaskManager.Task::(_updateState) Task=`fd9462ef-eb51-4a58-bbed-7f78dfb39a25`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:39:12,467::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:39:12,467::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:39:12,467::task::990::TaskManager.Task::(_decref) Task=`fd9462ef-eb51-4a58-bbed-7f78dfb39a25`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:39:12,471::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:39:12,471::task::595::TaskManager.Task::(_updateState) Task=`b1f988dd-d80a-41be-9906-a1d338739a1f`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:39:12,471::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:39:12,472::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`ad4841b6-ca34-420d-894d-34e3352862c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:39:12,472::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:39:12,473::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:39:12,474::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`ad4841b6-ca34-420d-894d-34e3352862c7`::Granted request >Thread-135152::DEBUG::2014-07-14 16:39:12,474::task::827::TaskManager.Task::(resourceAcquired) Task=`b1f988dd-d80a-41be-9906-a1d338739a1f`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:39:12,474::task::990::TaskManager.Task::(_decref) Task=`b1f988dd-d80a-41be-9906-a1d338739a1f`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:39:12,478::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3345306615808', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:39:12,478::task::1185::TaskManager.Task::(prepare) Task=`b1f988dd-d80a-41be-9906-a1d338739a1f`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3345306615808', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:39:12,478::task::595::TaskManager.Task::(_updateState) Task=`b1f988dd-d80a-41be-9906-a1d338739a1f`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:39:12,478::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:39:12,479::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:39:12,479::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:39:12,479::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:39:12,479::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:39:12,479::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:39:12,480::task::990::TaskManager.Task::(_decref) Task=`b1f988dd-d80a-41be-9906-a1d338739a1f`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:39:12,537::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:39:12,538::task::595::TaskManager.Task::(_updateState) Task=`124f1618-2460-47f5-b461-b87c5d0aade1`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:39:12,538::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:39:12,538::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:39:12,538::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:39:12,538::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:39:12,538::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:39:12,539::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:39:12,539::task::1185::TaskManager.Task::(prepare) Task=`124f1618-2460-47f5-b461-b87c5d0aade1`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:39:12,539::task::595::TaskManager.Task::(_updateState) Task=`124f1618-2460-47f5-b461-b87c5d0aade1`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:39:12,539::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:39:12,539::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:39:12,539::task::990::TaskManager.Task::(_decref) Task=`124f1618-2460-47f5-b461-b87c5d0aade1`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:39:12,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:12,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268277 s, 38.2 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:39:13,240::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:39:13,253::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000221284 s, 2.9 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:39:13,984::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:39:14,014::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000168563 s, 2.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:14,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:14,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0220083 s, 46.5 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:39:15,138::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:39:15,150::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000180264 s, 3.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:16,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:16,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267878 s, 38.2 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:39:17,183::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.06702685356 thisRx 1120695836 thisTx 1089084284 samples [(1405348747.910983, 1410681362916, 1464047375668), (1405348749.927044, 1410964613060, 1464318481724), (1405348751.944472, 1411239289940, 1464579687900), (1405348753.960187, 1411519432284, 1464865107164), (1405348755.97801, 1411802058752, 1465136459952)] >Thread-135151::DEBUG::2014-07-14 16:39:17,184::task::595::TaskManager.Task::(_updateState) Task=`09330a53-bf53-494b-82d2-91628123237d`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:39:17,184::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:39:17,184::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000221284', 'lastCheck': '3.9', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000174867', 'lastCheck': '4.7', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000347841', 'lastCheck': '6.7', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000168563', 'lastCheck': '3.2', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000180264', 'lastCheck': '2.0', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:39:17,185::task::1185::TaskManager.Task::(prepare) Task=`09330a53-bf53-494b-82d2-91628123237d`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000221284', 'lastCheck': '3.9', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000174867', 'lastCheck': '4.7', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000347841', 'lastCheck': '6.7', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000168563', 'lastCheck': '3.2', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000180264', 'lastCheck': '2.0', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:39:17,185::task::595::TaskManager.Task::(_updateState) Task=`09330a53-bf53-494b-82d2-91628123237d`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:39:17,185::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:39:17,185::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:39:17,186::task::990::TaskManager.Task::(_decref) Task=`09330a53-bf53-494b-82d2-91628123237d`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:39:18,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:18,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0256408 s, 39.9 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:39:20,502::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:39:20,514::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000191922 s, 1.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:20,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:21,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0221485 s, 46.2 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:39:22,451::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545 >Thread-11634::DEBUG::2014-07-14 16:39:22,465::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545 >Thread-11634::DEBUG::2014-07-14 16:39:22,471::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-11634::DEBUG::2014-07-14 16:39:22,478::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=colnas01_IB', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_DESCRIPTION=Collogia', 'POOL_DOMAINS=965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=5', 'POOL_UUID=94ed7a19-fade-4bd6-83f2-2cbb2f730b95', 'REMOTE_PATH=10.10.30.251:/var/nas1/OVirtIB', 'ROLE=Regular', 'SDUUID=965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=33104b1d06083e25e9500f69ce80b4a66b51257c'] >Thread-11634::DEBUG::2014-07-14 16:39:22,480::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-11634::INFO::2014-07-14 16:39:22,480::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545_imageNS already registered >Thread-11634::INFO::2014-07-14 16:39:22,480::sd::391::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545_volumeNS already registered >Thread-11634::DEBUG::2014-07-14 16:39:22,486::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:39:22,495::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000186576 s, 3.0 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:39:22,715::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [3670db61] >Thread-135151::DEBUG::2014-07-14 16:39:22,715::task::595::TaskManager.Task::(_updateState) Task=`933616e0-fb43-4087-863c-b1724d926673`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:39:22,716::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:39:22,716::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:39:22,716::task::1185::TaskManager.Task::(prepare) Task=`933616e0-fb43-4087-863c-b1724d926673`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:39:22,716::task::595::TaskManager.Task::(_updateState) Task=`933616e0-fb43-4087-863c-b1724d926673`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:39:22,717::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:39:22,717::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:39:22,717::task::990::TaskManager.Task::(_decref) Task=`933616e0-fb43-4087-863c-b1724d926673`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:39:22,721::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [3670db61] >Thread-135152::DEBUG::2014-07-14 16:39:22,722::task::595::TaskManager.Task::(_updateState) Task=`1040944c-2f78-4031-a438-e813b6dbdec5`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:39:22,722::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:39:22,722::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`d4de4bbb-cac3-4fe5-8ec3-e3125b58e8a2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:39:22,722::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:39:22,723::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:39:22,723::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`d4de4bbb-cac3-4fe5-8ec3-e3125b58e8a2`::Granted request >Thread-135152::DEBUG::2014-07-14 16:39:22,723::task::827::TaskManager.Task::(resourceAcquired) Task=`1040944c-2f78-4031-a438-e813b6dbdec5`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:39:22,724::task::990::TaskManager.Task::(_decref) Task=`1040944c-2f78-4031-a438-e813b6dbdec5`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:39:22,727::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3343964438528', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:39:22,728::task::1185::TaskManager.Task::(prepare) Task=`1040944c-2f78-4031-a438-e813b6dbdec5`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3343964438528', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:39:22,728::task::595::TaskManager.Task::(_updateState) Task=`1040944c-2f78-4031-a438-e813b6dbdec5`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:39:22,728::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:39:22,728::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:39:22,728::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:39:22,729::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:39:22,729::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:39:22,729::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:39:22,729::task::990::TaskManager.Task::(_decref) Task=`1040944c-2f78-4031-a438-e813b6dbdec5`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:39:22,826::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:39:22,827::task::595::TaskManager.Task::(_updateState) Task=`1d56802f-01a9-47ed-b034-d928306f78f9`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:39:22,827::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:39:22,827::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:39:22,828::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:39:22,828::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:39:22,828::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:39:22,828::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:39:22,828::task::1185::TaskManager.Task::(prepare) Task=`1d56802f-01a9-47ed-b034-d928306f78f9`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:39:22,829::task::595::TaskManager.Task::(_updateState) Task=`1d56802f-01a9-47ed-b034-d928306f78f9`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:39:22,829::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:39:22,829::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:39:22,829::task::990::TaskManager.Task::(_decref) Task=`1d56802f-01a9-47ed-b034-d928306f78f9`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:39:23,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:23,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273402 s, 37.5 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:39:23,261::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:39:23,271::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000323391 s, 2.0 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:39:24,023::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:39:24,034::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000173574 s, 2.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:25,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:39:25,175::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:39:25,187::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000295673 s, 1.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:25,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.066321 s, 15.4 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:27,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:27,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0226638 s, 45.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:29,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:29,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030705 s, 33.3 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:39:30,519::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:39:30,530::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.00190223 s, 188 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:31,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:31,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273365 s, 37.5 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:39:32,330::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.08083510399 thisRx 1138641080 thisTx 1118884524 samples [(1405348764.057653, 1412951954592, 1466257874524), (1405348766.07519, 1413221426200, 1466528712132), (1405348768.097078, 1413506801696, 1466803038060), (1405348770.115461, 1413799869448, 1467094859832), (1405348772.138488, 1414090595672, 1467376759048)] >Thread-135151::DEBUG::2014-07-14 16:39:32,331::task::595::TaskManager.Task::(_updateState) Task=`ff5888ff-de46-4254-92e7-d975d9143145`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:39:32,331::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:39:32,332::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000323391', 'lastCheck': '9.1', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000186576', 'lastCheck': '9.8', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00190223', 'lastCheck': '1.8', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000173574', 'lastCheck': '8.3', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000295673', 'lastCheck': '7.1', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:39:32,332::task::1185::TaskManager.Task::(prepare) Task=`ff5888ff-de46-4254-92e7-d975d9143145`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000323391', 'lastCheck': '9.1', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000186576', 'lastCheck': '9.8', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00190223', 'lastCheck': '1.8', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000173574', 'lastCheck': '8.3', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000295673', 'lastCheck': '7.1', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:39:32,332::task::595::TaskManager.Task::(_updateState) Task=`ff5888ff-de46-4254-92e7-d975d9143145`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:39:32,333::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:39:32,333::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:39:32,333::task::990::TaskManager.Task::(_decref) Task=`ff5888ff-de46-4254-92e7-d975d9143145`::ref 0 aborting False >Thread-11634::DEBUG::2014-07-14 16:39:32,533::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:39:32,558::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00489624 s, 114 kB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:39:32,952::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:39:32,953::task::595::TaskManager.Task::(_updateState) Task=`12b80647-8363-4c9d-aa6f-27fd224c0aa6`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:39:32,953::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:39:32,953::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:39:32,954::task::1185::TaskManager.Task::(prepare) Task=`12b80647-8363-4c9d-aa6f-27fd224c0aa6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:39:32,954::task::595::TaskManager.Task::(_updateState) Task=`12b80647-8363-4c9d-aa6f-27fd224c0aa6`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:39:32,954::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:39:32,954::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:39:32,954::task::990::TaskManager.Task::(_decref) Task=`12b80647-8363-4c9d-aa6f-27fd224c0aa6`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:39:32,957::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:39:32,958::task::595::TaskManager.Task::(_updateState) Task=`4114ed20-3806-4991-9130-ffaa60669caf`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:39:32,958::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:39:32,958::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`ac5094b3-e1c7-4a40-8c4a-6da4273b820d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:39:32,958::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:39:32,959::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:39:32,959::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`ac5094b3-e1c7-4a40-8c4a-6da4273b820d`::Granted request >Thread-135152::DEBUG::2014-07-14 16:39:32,959::task::827::TaskManager.Task::(resourceAcquired) Task=`4114ed20-3806-4991-9130-ffaa60669caf`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:39:32,959::task::990::TaskManager.Task::(_decref) Task=`4114ed20-3806-4991-9130-ffaa60669caf`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:39:32,962::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3342621212672', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:39:32,962::task::1185::TaskManager.Task::(prepare) Task=`4114ed20-3806-4991-9130-ffaa60669caf`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3342621212672', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:39:32,963::task::595::TaskManager.Task::(_updateState) Task=`4114ed20-3806-4991-9130-ffaa60669caf`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:39:32,963::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:39:32,963::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:39:32,963::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:39:32,963::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:39:32,963::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:39:32,963::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:39:32,964::task::990::TaskManager.Task::(_decref) Task=`4114ed20-3806-4991-9130-ffaa60669caf`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:39:33,033::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:39:33,033::task::595::TaskManager.Task::(_updateState) Task=`03e5d795-be68-47ae-a2d3-f0bc333f9184`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:39:33,033::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:39:33,034::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:39:33,034::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:39:33,034::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:39:33,034::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:39:33,034::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:39:33,034::task::1185::TaskManager.Task::(prepare) Task=`03e5d795-be68-47ae-a2d3-f0bc333f9184`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:39:33,034::task::595::TaskManager.Task::(_updateState) Task=`03e5d795-be68-47ae-a2d3-f0bc333f9184`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:39:33,035::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:39:33,035::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:39:33,035::task::990::TaskManager.Task::(_decref) Task=`03e5d795-be68-47ae-a2d3-f0bc333f9184`::ref 0 aborting False >Thread-11633::DEBUG::2014-07-14 16:39:33,278::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:39:33,295::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000211164 s, 3.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:33,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:33,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360257 s, 28.4 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:39:34,040::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:39:34,049::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000200566 s, 1.8 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:39:35,198::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:39:35,206::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000169905 s, 3.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:35,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:35,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301725 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:37,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:37,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.022441 s, 45.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:39,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:39,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0223151 s, 45.9 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:39:40,536::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:39:40,549::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000278402 s, 1.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:41,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:41,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0254147 s, 40.3 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:39:42,569::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:39:42,578::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000219153 s, 2.5 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:39:43,293::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:39:43,294::task::595::TaskManager.Task::(_updateState) Task=`de173cc7-964a-42d0-a8bf-3c36cca7a876`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:39:43,294::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:39:43,294::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:39:43,294::task::1185::TaskManager.Task::(prepare) Task=`de173cc7-964a-42d0-a8bf-3c36cca7a876`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:39:43,295::task::595::TaskManager.Task::(_updateState) Task=`de173cc7-964a-42d0-a8bf-3c36cca7a876`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:39:43,295::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:39:43,295::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:39:43,295::task::990::TaskManager.Task::(_decref) Task=`de173cc7-964a-42d0-a8bf-3c36cca7a876`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:39:43,299::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:39:43,299::task::595::TaskManager.Task::(_updateState) Task=`c3d5cea7-6217-4601-9e2c-9e22f20489b4`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:39:43,300::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:39:43,301::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`e5f7c67b-435b-47a3-bfa2-0a84990f9054`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:39:43,302::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:39:43,304::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:39:43,305::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`e5f7c67b-435b-47a3-bfa2-0a84990f9054`::Granted request >Thread-135152::DEBUG::2014-07-14 16:39:43,308::task::827::TaskManager.Task::(resourceAcquired) Task=`c3d5cea7-6217-4601-9e2c-9e22f20489b4`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:39:43,309::task::990::TaskManager.Task::(_decref) Task=`c3d5cea7-6217-4601-9e2c-9e22f20489b4`::ref 1 aborting False >Thread-11633::DEBUG::2014-07-14 16:39:43,327::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:39:43,340::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000196631 s, 3.3 MB/s\n'; <rc> = 0 >Thread-135152::INFO::2014-07-14 16:39:43,342::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341264355328', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:39:43,342::task::1185::TaskManager.Task::(prepare) Task=`c3d5cea7-6217-4601-9e2c-9e22f20489b4`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341264355328', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:39:43,343::task::595::TaskManager.Task::(_updateState) Task=`c3d5cea7-6217-4601-9e2c-9e22f20489b4`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:39:43,344::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:39:43,345::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:39:43,347::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:39:43,347::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:39:43,347::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:39:43,347::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:39:43,348::task::990::TaskManager.Task::(_decref) Task=`c3d5cea7-6217-4601-9e2c-9e22f20489b4`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:39:43,422::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:39:43,422::task::595::TaskManager.Task::(_updateState) Task=`be064936-28e6-4ccd-a187-f8a4df0241c7`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:39:43,422::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:39:43,422::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:39:43,423::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:39:43,423::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:39:43,423::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:39:43,423::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:39:43,423::task::1185::TaskManager.Task::(prepare) Task=`be064936-28e6-4ccd-a187-f8a4df0241c7`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:39:43,423::task::595::TaskManager.Task::(_updateState) Task=`be064936-28e6-4ccd-a187-f8a4df0241c7`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:39:43,424::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:39:43,424::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:39:43,424::task::990::TaskManager.Task::(_decref) Task=`be064936-28e6-4ccd-a187-f8a4df0241c7`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:39:43,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:43,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317793 s, 32.2 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:39:44,055::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:39:44,071::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.00420206 s, 86.4 kB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:39:45,211::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:39:45,221::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000218803 s, 2.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:45,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:45,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0466623 s, 21.9 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:39:47,491::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.06870889664 thisRx 2056878120 thisTx 696070164 samples [(1405348778.18951, 1414941768040, 1468216463116), (1405348780.205632, 1415234828684, 1468513433148), (1405348782.220386, 1415520420508, 1468787019536), (1405348784.234616, 1416060235688, 1468909105544), (1405348786.258219, 1416998646160, 1468912533280)] >Thread-135151::DEBUG::2014-07-14 16:39:47,492::task::595::TaskManager.Task::(_updateState) Task=`32b545e4-508c-42eb-8fbb-557185515e23`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:39:47,493::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:39:47,493::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000196631', 'lastCheck': '4.1', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000219153', 'lastCheck': '4.9', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000278402', 'lastCheck': '6.9', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00420206', 'lastCheck': '3.4', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000218803', 'lastCheck': '2.3', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:39:47,493::task::1185::TaskManager.Task::(prepare) Task=`32b545e4-508c-42eb-8fbb-557185515e23`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000196631', 'lastCheck': '4.1', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000219153', 'lastCheck': '4.9', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000278402', 'lastCheck': '6.9', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00420206', 'lastCheck': '3.4', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000218803', 'lastCheck': '2.3', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:39:47,493::task::595::TaskManager.Task::(_updateState) Task=`32b545e4-508c-42eb-8fbb-557185515e23`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:39:47,494::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:39:47,494::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:39:47,494::task::990::TaskManager.Task::(_decref) Task=`32b545e4-508c-42eb-8fbb-557185515e23`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:39:47,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:48,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.049409 s, 20.7 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:50,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:50,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342907 s, 29.9 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:39:50,558::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:39:50,569::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000185327 s, 1.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:52,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:52,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349603 s, 29.3 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:39:52,584::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:39:52,624::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.012485 s, 44.6 kB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:39:53,358::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:39:53,379::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.0103287 s, 62.4 kB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:39:53,578::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [44abe31] >Thread-135151::DEBUG::2014-07-14 16:39:53,579::task::595::TaskManager.Task::(_updateState) Task=`71348339-922f-4354-b689-eb4b7dac9c6b`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:39:53,579::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:39:53,579::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:39:53,579::task::1185::TaskManager.Task::(prepare) Task=`71348339-922f-4354-b689-eb4b7dac9c6b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:39:53,580::task::595::TaskManager.Task::(_updateState) Task=`71348339-922f-4354-b689-eb4b7dac9c6b`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:39:53,580::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:39:53,580::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:39:53,580::task::990::TaskManager.Task::(_decref) Task=`71348339-922f-4354-b689-eb4b7dac9c6b`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:39:53,584::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [44abe31] >Thread-135152::DEBUG::2014-07-14 16:39:53,584::task::595::TaskManager.Task::(_updateState) Task=`a67b7b30-dc3a-4044-a46c-22bbd9d484b2`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:39:53,584::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:39:53,585::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`14ebb662-696f-420e-8dde-20594830466f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:39:53,585::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:39:53,585::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:39:53,586::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`14ebb662-696f-420e-8dde-20594830466f`::Granted request >Thread-135152::DEBUG::2014-07-14 16:39:53,586::task::827::TaskManager.Task::(resourceAcquired) Task=`a67b7b30-dc3a-4044-a46c-22bbd9d484b2`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:39:53,586::task::990::TaskManager.Task::(_decref) Task=`a67b7b30-dc3a-4044-a46c-22bbd9d484b2`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:39:53,590::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341195149312', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:39:53,590::task::1185::TaskManager.Task::(prepare) Task=`a67b7b30-dc3a-4044-a46c-22bbd9d484b2`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341195149312', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:39:53,591::task::595::TaskManager.Task::(_updateState) Task=`a67b7b30-dc3a-4044-a46c-22bbd9d484b2`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:39:53,591::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:39:53,591::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:39:53,591::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:39:53,591::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:39:53,592::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:39:53,592::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:39:53,592::task::990::TaskManager.Task::(_decref) Task=`a67b7b30-dc3a-4044-a46c-22bbd9d484b2`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:39:53,667::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [3670db61] >Thread-135151::DEBUG::2014-07-14 16:39:53,668::task::595::TaskManager.Task::(_updateState) Task=`315bf3c7-080b-4fed-810b-ff1554fbb9aa`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:39:53,668::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:39:53,668::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:39:53,668::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:39:53,668::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:39:53,668::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:39:53,669::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:39:53,669::task::1185::TaskManager.Task::(prepare) Task=`315bf3c7-080b-4fed-810b-ff1554fbb9aa`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:39:53,669::task::595::TaskManager.Task::(_updateState) Task=`315bf3c7-080b-4fed-810b-ff1554fbb9aa`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:39:53,669::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:39:53,669::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:39:53,670::task::990::TaskManager.Task::(_decref) Task=`315bf3c7-080b-4fed-810b-ff1554fbb9aa`::ref 0 aborting False >Thread-11641::DEBUG::2014-07-14 16:39:54,081::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:39:54,104::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.0138995 s, 26.1 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:54,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:54,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0615176 s, 16.6 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:39:55,236::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:39:55,252::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00150778 s, 369 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:56,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:56,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278192 s, 36.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:39:58,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:39:58,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365961 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:00,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:40:00,580::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:40:00,603::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.012311 s, 29.0 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:00,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0668848 s, 15.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:02,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-135151::DEBUG::2014-07-14 16:40:02,650::task::595::TaskManager.Task::(_updateState) Task=`80127a41-fbe7-4d88-91a4-bd718f401418`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:40:02,651::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:40:02,651::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0103287', 'lastCheck': '9.3', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.012485', 'lastCheck': '10.0', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.012311', 'lastCheck': '2.0', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0138995', 'lastCheck': '8.5', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00150778', 'lastCheck': '7.4', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:40:02,651::task::1185::TaskManager.Task::(prepare) Task=`80127a41-fbe7-4d88-91a4-bd718f401418`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0103287', 'lastCheck': '9.3', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.012485', 'lastCheck': '10.0', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.012311', 'lastCheck': '2.0', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0138995', 'lastCheck': '8.5', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00150778', 'lastCheck': '7.4', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:40:02,651::task::595::TaskManager.Task::(_updateState) Task=`80127a41-fbe7-4d88-91a4-bd718f401418`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:40:02,652::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:40:02,652::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:40:02,652::task::990::TaskManager.Task::(_decref) Task=`80127a41-fbe7-4d88-91a4-bd718f401418`::ref 0 aborting False >Thread-11634::DEBUG::2014-07-14 16:40:02,667::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:40:02,699::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00100045 s, 557 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:02,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0768556 s, 13.3 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:40:03,386::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:40:03,400::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.00345732 s, 186 kB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:40:03,847::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:40:03,847::task::595::TaskManager.Task::(_updateState) Task=`a3c393b7-4492-4ffc-9524-c48e7babc533`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:40:03,848::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:40:03,848::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:40:03,848::task::1185::TaskManager.Task::(prepare) Task=`a3c393b7-4492-4ffc-9524-c48e7babc533`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:40:03,848::task::595::TaskManager.Task::(_updateState) Task=`a3c393b7-4492-4ffc-9524-c48e7babc533`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:40:03,849::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:40:03,849::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:40:03,849::task::990::TaskManager.Task::(_decref) Task=`a3c393b7-4492-4ffc-9524-c48e7babc533`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:40:03,853::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:40:03,854::task::595::TaskManager.Task::(_updateState) Task=`65b42ffe-7e1a-4504-8500-5666227d488d`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:40:03,854::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:40:03,854::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`b9a23083-de30-4b64-ab99-f32ce9c19406`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:40:03,855::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:40:03,855::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:40:03,855::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`b9a23083-de30-4b64-ab99-f32ce9c19406`::Granted request >Thread-135152::DEBUG::2014-07-14 16:40:03,855::task::827::TaskManager.Task::(resourceAcquired) Task=`65b42ffe-7e1a-4504-8500-5666227d488d`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:40:03,856::task::990::TaskManager.Task::(_decref) Task=`65b42ffe-7e1a-4504-8500-5666227d488d`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:40:03,859::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341195149312', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:40:03,859::task::1185::TaskManager.Task::(prepare) Task=`65b42ffe-7e1a-4504-8500-5666227d488d`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341195149312', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:40:03,860::task::595::TaskManager.Task::(_updateState) Task=`65b42ffe-7e1a-4504-8500-5666227d488d`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:40:03,860::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:40:03,860::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:40:03,860::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:40:03,861::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:40:03,861::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:40:03,861::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:40:03,861::task::990::TaskManager.Task::(_decref) Task=`65b42ffe-7e1a-4504-8500-5666227d488d`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:40:03,929::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:40:03,930::task::595::TaskManager.Task::(_updateState) Task=`3a239f8b-1085-48a2-a950-7d955d4f9b9b`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:40:03,930::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:40:03,930::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:40:03,930::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:40:03,930::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:40:03,930::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:40:03,931::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:40:03,931::task::1185::TaskManager.Task::(prepare) Task=`3a239f8b-1085-48a2-a950-7d955d4f9b9b`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:40:03,931::task::595::TaskManager.Task::(_updateState) Task=`3a239f8b-1085-48a2-a950-7d955d4f9b9b`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:40:03,931::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:40:03,931::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:40:03,932::task::990::TaskManager.Task::(_decref) Task=`3a239f8b-1085-48a2-a950-7d955d4f9b9b`::ref 0 aborting False >Thread-11641::DEBUG::2014-07-14 16:40:04,110::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:40:04,123::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.00277905 s, 131 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:04,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:04,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381225 s, 26.9 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:40:05,260::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:40:05,271::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00259892 s, 214 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:06,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:06,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0559577 s, 18.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:08,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:08,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0225487 s, 45.4 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:40:10,612::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:40:10,622::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.0011152 s, 320 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:10,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:11,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296538 s, 34.5 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:40:12,756::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:40:12,766::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000198411 s, 2.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:13,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:13,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030702 s, 33.4 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:40:13,419::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:40:13,428::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000695057 s, 927 kB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:40:14,045::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:40:14,046::task::595::TaskManager.Task::(_updateState) Task=`94d263c6-d692-4d2b-bc43-5f4daf495542`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:40:14,047::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:40:14,047::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:40:14,047::task::1185::TaskManager.Task::(prepare) Task=`94d263c6-d692-4d2b-bc43-5f4daf495542`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:40:14,047::task::595::TaskManager.Task::(_updateState) Task=`94d263c6-d692-4d2b-bc43-5f4daf495542`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:40:14,048::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:40:14,048::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:40:14,048::task::990::TaskManager.Task::(_decref) Task=`94d263c6-d692-4d2b-bc43-5f4daf495542`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:40:14,052::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:40:14,052::task::595::TaskManager.Task::(_updateState) Task=`3ce1cb51-c744-4a1c-b9c7-b2024d85985b`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:40:14,052::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:40:14,053::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`4d3e8844-0f32-49ad-a1b9-282eb236c65e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:40:14,053::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:40:14,053::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:40:14,053::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`4d3e8844-0f32-49ad-a1b9-282eb236c65e`::Granted request >Thread-135152::DEBUG::2014-07-14 16:40:14,054::task::827::TaskManager.Task::(resourceAcquired) Task=`3ce1cb51-c744-4a1c-b9c7-b2024d85985b`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:40:14,054::task::990::TaskManager.Task::(_decref) Task=`3ce1cb51-c744-4a1c-b9c7-b2024d85985b`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:40:14,058::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341194100736', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:40:14,058::task::1185::TaskManager.Task::(prepare) Task=`3ce1cb51-c744-4a1c-b9c7-b2024d85985b`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341194100736', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735222136832', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:40:14,058::task::595::TaskManager.Task::(_updateState) Task=`3ce1cb51-c744-4a1c-b9c7-b2024d85985b`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:40:14,058::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:40:14,058::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:40:14,059::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:40:14,059::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:40:14,059::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:40:14,059::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:40:14,060::task::990::TaskManager.Task::(_decref) Task=`3ce1cb51-c744-4a1c-b9c7-b2024d85985b`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:40:14,116::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:40:14,116::task::595::TaskManager.Task::(_updateState) Task=`943c99d9-aeeb-4c8f-9c51-68a618f403ef`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:40:14,117::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:40:14,117::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:40:14,117::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:40:14,117::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:40:14,117::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:40:14,117::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:40:14,118::task::1185::TaskManager.Task::(prepare) Task=`943c99d9-aeeb-4c8f-9c51-68a618f403ef`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:40:14,118::task::595::TaskManager.Task::(_updateState) Task=`943c99d9-aeeb-4c8f-9c51-68a618f403ef`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:40:14,118::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:40:14,118::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:40:14,118::task::990::TaskManager.Task::(_decref) Task=`943c99d9-aeeb-4c8f-9c51-68a618f403ef`::ref 0 aborting False >Thread-11641::DEBUG::2014-07-14 16:40:14,129::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:40:14,136::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000158778 s, 2.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:15,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:15,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.025668 s, 39.9 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:40:15,277::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 272ec473-6041-42ee-bd1a-732789dd18d4 >Thread-11647::DEBUG::2014-07-14 16:40:15,290::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4 >Thread-11647::DEBUG::2014-07-14 16:40:15,292::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-11647::DEBUG::2014-07-14 16:40:15,294::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=colnas02_IB', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_DESCRIPTION=Collogia', 'POOL_DOMAINS=965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=5', 'POOL_UUID=94ed7a19-fade-4bd6-83f2-2cbb2f730b95', 'REMOTE_PATH=10.10.30.252:/var/nas2/OVirtIB', 'ROLE=Regular', 'SDUUID=272ec473-6041-42ee-bd1a-732789dd18d4', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=101ee262507ad44a448dbc39eebf0320e49150e4'] >Thread-11647::DEBUG::2014-07-14 16:40:15,295::fileSD::609::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-11647::INFO::2014-07-14 16:40:15,295::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 272ec473-6041-42ee-bd1a-732789dd18d4_imageNS already registered >Thread-11647::INFO::2014-07-14 16:40:15,296::sd::391::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 272ec473-6041-42ee-bd1a-732789dd18d4_volumeNS already registered >Thread-11647::DEBUG::2014-07-14 16:40:15,306::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:40:15,320::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00414504 s, 134 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:17,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:17,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0420636 s, 24.3 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:40:17,873::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.06693410873 thisRx 2590138184 thisTx 10932120 samples [(1405348808.524423, 1428968275524, 1468954421180), (1405348810.542279, 1429159739824, 1468955547240), (1405348812.556695, 1429929580676, 1468958894932), (1405348814.57706, 1430774215048, 1468962049872), (1405348816.591357, 1431558413708, 1468965353300)] >Thread-135151::DEBUG::2014-07-14 16:40:17,874::task::595::TaskManager.Task::(_updateState) Task=`82c9a561-b25f-4d1d-8abc-93a4ea17b758`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:40:17,875::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:40:17,875::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695057', 'lastCheck': '4.4', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000198411', 'lastCheck': '5.1', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011152', 'lastCheck': '7.3', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000158778', 'lastCheck': '3.7', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00414504', 'lastCheck': '2.6', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:40:17,875::task::1185::TaskManager.Task::(prepare) Task=`82c9a561-b25f-4d1d-8abc-93a4ea17b758`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695057', 'lastCheck': '4.4', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000198411', 'lastCheck': '5.1', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011152', 'lastCheck': '7.3', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000158778', 'lastCheck': '3.7', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00414504', 'lastCheck': '2.6', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:40:17,876::task::595::TaskManager.Task::(_updateState) Task=`82c9a561-b25f-4d1d-8abc-93a4ea17b758`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:40:17,876::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:40:17,876::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:40:17,876::task::990::TaskManager.Task::(_decref) Task=`82c9a561-b25f-4d1d-8abc-93a4ea17b758`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:40:19,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:19,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455021 s, 22.5 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:40:20,640::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:40:20,655::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.00583841 s, 61.1 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:21,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:21,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272911 s, 37.5 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:40:22,782::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:40:22,833::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00141857 s, 393 kB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:40:23,437::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:23,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:40:23,463::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.0171889 s, 37.5 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:23,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0459337 s, 22.3 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:40:24,141::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:40:24,160::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.00571035 s, 63.6 kB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:40:24,295::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [44abe31] >Thread-135151::DEBUG::2014-07-14 16:40:24,296::task::595::TaskManager.Task::(_updateState) Task=`01fe45fa-5d63-41ab-8673-1a66561e17ff`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:40:24,296::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:40:24,297::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:40:24,297::task::1185::TaskManager.Task::(prepare) Task=`01fe45fa-5d63-41ab-8673-1a66561e17ff`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:40:24,297::task::595::TaskManager.Task::(_updateState) Task=`01fe45fa-5d63-41ab-8673-1a66561e17ff`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:40:24,297::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:40:24,297::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:40:24,297::task::990::TaskManager.Task::(_decref) Task=`01fe45fa-5d63-41ab-8673-1a66561e17ff`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:40:24,302::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [44abe31] >Thread-135152::DEBUG::2014-07-14 16:40:24,302::task::595::TaskManager.Task::(_updateState) Task=`070bc564-729c-4a0b-a840-6b234e72c32f`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:40:24,302::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:40:24,303::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`f570810c-b5e9-4c3e-97cb-ec132341d699`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:40:24,303::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:40:24,303::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:40:24,304::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`f570810c-b5e9-4c3e-97cb-ec132341d699`::Granted request >Thread-135152::DEBUG::2014-07-14 16:40:24,305::task::827::TaskManager.Task::(resourceAcquired) Task=`070bc564-729c-4a0b-a840-6b234e72c32f`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:40:24,305::task::990::TaskManager.Task::(_decref) Task=`070bc564-729c-4a0b-a840-6b234e72c32f`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:40:24,309::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341194100736', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:40:24,309::task::1185::TaskManager.Task::(prepare) Task=`070bc564-729c-4a0b-a840-6b234e72c32f`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341194100736', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:40:24,309::task::595::TaskManager.Task::(_updateState) Task=`070bc564-729c-4a0b-a840-6b234e72c32f`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:40:24,310::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:40:24,310::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:40:24,310::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:40:24,310::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:40:24,310::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:40:24,310::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:40:24,311::task::990::TaskManager.Task::(_decref) Task=`070bc564-729c-4a0b-a840-6b234e72c32f`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:40:24,367::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [3670db61] >Thread-135151::DEBUG::2014-07-14 16:40:24,368::task::595::TaskManager.Task::(_updateState) Task=`0464feb4-dede-4d06-a221-0fac489bf14f`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:40:24,368::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:40:24,368::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:40:24,368::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:40:24,368::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:40:24,368::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:40:24,369::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:40:24,369::task::1185::TaskManager.Task::(prepare) Task=`0464feb4-dede-4d06-a221-0fac489bf14f`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:40:24,369::task::595::TaskManager.Task::(_updateState) Task=`0464feb4-dede-4d06-a221-0fac489bf14f`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:40:24,369::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:40:24,369::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:40:24,369::task::990::TaskManager.Task::(_decref) Task=`0464feb4-dede-4d06-a221-0fac489bf14f`::ref 0 aborting False >Thread-11647::DEBUG::2014-07-14 16:40:25,326::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:40:25,341::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000498541 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:25,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:25,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0407889 s, 25.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:27,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:27,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391995 s, 26.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:29,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:29,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0221137 s, 46.3 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:40:30,661::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:40:30,681::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.00399639 s, 89.3 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:31,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:32,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.112109 s, 9.1 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:40:32,859::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:40:32,880::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000816877 s, 682 kB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:40:33,014::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid ib0 interval: 8.0752530098 thisRx 3532258612 thisTx 15645580 samples [(1405348824.675219, 1436162416016, 1468982552864), (1405348826.696454, 1437342198188, 1468986747476), (1405348828.711079, 1438262162744, 1468990868956), (1405348830.725995, 1438611196140, 1468992773184), (1405348832.750472, 1439694674628, 1468998198444)] >Thread-135151::DEBUG::2014-07-14 16:40:33,016::task::595::TaskManager.Task::(_updateState) Task=`497e6610-bdfd-4a0b-bf2b-aa2d9f3d1498`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:40:33,016::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:40:33,016::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0171889', 'lastCheck': '9.5', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000816877', 'lastCheck': '0.1', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00399639', 'lastCheck': '2.3', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00571035', 'lastCheck': '8.9', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000498541', 'lastCheck': '7.7', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:40:33,017::task::1185::TaskManager.Task::(prepare) Task=`497e6610-bdfd-4a0b-bf2b-aa2d9f3d1498`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0171889', 'lastCheck': '9.5', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000816877', 'lastCheck': '0.1', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00399639', 'lastCheck': '2.3', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00571035', 'lastCheck': '8.9', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000498541', 'lastCheck': '7.7', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:40:33,017::task::595::TaskManager.Task::(_updateState) Task=`497e6610-bdfd-4a0b-bf2b-aa2d9f3d1498`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:40:33,017::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:40:33,017::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:40:33,018::task::990::TaskManager.Task::(_decref) Task=`497e6610-bdfd-4a0b-bf2b-aa2d9f3d1498`::ref 0 aborting False >Thread-11633::DEBUG::2014-07-14 16:40:33,482::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:40:33,490::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000172054 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:34,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:40:34,187::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:40:34,218::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.0174658 s, 20.8 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:34,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0658571 s, 15.5 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:40:34,513::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:40:34,513::task::595::TaskManager.Task::(_updateState) Task=`209f307c-3b83-471b-9344-2278067f59aa`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:40:34,513::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:40:34,514::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:40:34,514::task::1185::TaskManager.Task::(prepare) Task=`209f307c-3b83-471b-9344-2278067f59aa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:40:34,514::task::595::TaskManager.Task::(_updateState) Task=`209f307c-3b83-471b-9344-2278067f59aa`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:40:34,514::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:40:34,514::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:40:34,515::task::990::TaskManager.Task::(_decref) Task=`209f307c-3b83-471b-9344-2278067f59aa`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:40:34,518::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:40:34,519::task::595::TaskManager.Task::(_updateState) Task=`117702a6-6658-48fb-9904-9c11b98c56a0`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:40:34,519::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:40:34,519::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`f0ea42db-210f-42da-b902-784a102c1f69`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:40:34,520::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:40:34,520::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:40:34,520::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`f0ea42db-210f-42da-b902-784a102c1f69`::Granted request >Thread-135152::DEBUG::2014-07-14 16:40:34,520::task::827::TaskManager.Task::(resourceAcquired) Task=`117702a6-6658-48fb-9904-9c11b98c56a0`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:40:34,521::task::990::TaskManager.Task::(_decref) Task=`117702a6-6658-48fb-9904-9c11b98c56a0`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:40:34,524::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341193052160', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:40:34,525::task::1185::TaskManager.Task::(prepare) Task=`117702a6-6658-48fb-9904-9c11b98c56a0`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341193052160', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:40:34,525::task::595::TaskManager.Task::(_updateState) Task=`117702a6-6658-48fb-9904-9c11b98c56a0`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:40:34,525::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:40:34,525::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:40:34,525::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:40:34,526::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:40:34,526::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:40:34,526::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:40:34,526::task::990::TaskManager.Task::(_decref) Task=`117702a6-6658-48fb-9904-9c11b98c56a0`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:40:34,593::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:40:34,594::task::595::TaskManager.Task::(_updateState) Task=`4c73b3dc-54fc-499a-988e-116757db6306`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:40:34,594::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:40:34,594::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:40:34,594::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:40:34,594::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:40:34,594::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:40:34,595::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:40:34,595::task::1185::TaskManager.Task::(prepare) Task=`4c73b3dc-54fc-499a-988e-116757db6306`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:40:34,595::task::595::TaskManager.Task::(_updateState) Task=`4c73b3dc-54fc-499a-988e-116757db6306`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:40:34,595::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:40:34,595::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:40:34,595::task::990::TaskManager.Task::(_decref) Task=`4c73b3dc-54fc-499a-988e-116757db6306`::ref 0 aborting False >Thread-11647::DEBUG::2014-07-14 16:40:35,348::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:40:35,357::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000182169 s, 3.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:36,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:36,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351941 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:38,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:38,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0546544 s, 18.7 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:40,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:40,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284856 s, 35.9 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:40:40,697::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:40:40,719::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000712533 s, 501 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:42,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:42,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300705 s, 34.1 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:40:42,910::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:40:42,979::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000393029 s, 1.4 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:40:43,503::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:40:43,524::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.0122343 s, 52.6 kB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:40:44,227::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:40:44,236::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000361438 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:44,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:44,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0414649 s, 24.7 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:40:44,785::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:40:44,786::task::595::TaskManager.Task::(_updateState) Task=`1755e97e-3b4d-4549-b527-9ca0c231aac8`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:40:44,786::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:40:44,786::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:40:44,787::task::1185::TaskManager.Task::(prepare) Task=`1755e97e-3b4d-4549-b527-9ca0c231aac8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:40:44,787::task::595::TaskManager.Task::(_updateState) Task=`1755e97e-3b4d-4549-b527-9ca0c231aac8`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:40:44,787::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:40:44,787::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:40:44,787::task::990::TaskManager.Task::(_decref) Task=`1755e97e-3b4d-4549-b527-9ca0c231aac8`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:40:44,790::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:40:44,791::task::595::TaskManager.Task::(_updateState) Task=`3aa7cce8-9742-42f3-91e1-e24d0769a84a`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:40:44,791::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:40:44,791::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`e67e4e5f-ac5e-4dd6-9277-9aa0f86b4cd6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:40:44,792::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:40:44,792::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:40:44,792::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`e67e4e5f-ac5e-4dd6-9277-9aa0f86b4cd6`::Granted request >Thread-135152::DEBUG::2014-07-14 16:40:44,792::task::827::TaskManager.Task::(resourceAcquired) Task=`3aa7cce8-9742-42f3-91e1-e24d0769a84a`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:40:44,792::task::990::TaskManager.Task::(_decref) Task=`3aa7cce8-9742-42f3-91e1-e24d0769a84a`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:40:44,795::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341194100736', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:40:44,796::task::1185::TaskManager.Task::(prepare) Task=`3aa7cce8-9742-42f3-91e1-e24d0769a84a`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341194100736', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:40:44,796::task::595::TaskManager.Task::(_updateState) Task=`3aa7cce8-9742-42f3-91e1-e24d0769a84a`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:40:44,796::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:40:44,796::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:40:44,796::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:40:44,797::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:40:44,797::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:40:44,797::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:40:44,797::task::990::TaskManager.Task::(_decref) Task=`3aa7cce8-9742-42f3-91e1-e24d0769a84a`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:40:44,858::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:40:44,859::task::595::TaskManager.Task::(_updateState) Task=`3ac7ae9c-d7a6-4c08-aefb-ec907b92ff09`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:40:44,859::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:40:44,859::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:40:44,859::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:40:44,859::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:40:44,859::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:40:44,860::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:40:44,860::task::1185::TaskManager.Task::(prepare) Task=`3ac7ae9c-d7a6-4c08-aefb-ec907b92ff09`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:40:44,860::task::595::TaskManager.Task::(_updateState) Task=`3ac7ae9c-d7a6-4c08-aefb-ec907b92ff09`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:40:44,860::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:40:44,860::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:40:44,860::task::990::TaskManager.Task::(_decref) Task=`3ac7ae9c-d7a6-4c08-aefb-ec907b92ff09`::ref 0 aborting False >Thread-11647::DEBUG::2014-07-14 16:40:45,364::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:40:45,377::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000777953 s, 716 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:46,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:46,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308661 s, 33.2 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:40:48,179::task::595::TaskManager.Task::(_updateState) Task=`f7991db3-7f46-44cd-9e00-eadd0c6a9a70`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:40:48,179::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:40:48,179::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0122343', 'lastCheck': '4.7', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393029', 'lastCheck': '5.2', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000712533', 'lastCheck': '7.5', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000361438', 'lastCheck': '3.9', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000777953', 'lastCheck': '2.8', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:40:48,179::task::1185::TaskManager.Task::(prepare) Task=`f7991db3-7f46-44cd-9e00-eadd0c6a9a70`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0122343', 'lastCheck': '4.7', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393029', 'lastCheck': '5.2', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000712533', 'lastCheck': '7.5', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000361438', 'lastCheck': '3.9', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000777953', 'lastCheck': '2.8', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:40:48,179::task::595::TaskManager.Task::(_updateState) Task=`f7991db3-7f46-44cd-9e00-eadd0c6a9a70`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:40:48,180::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:40:48,180::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:40:48,180::task::990::TaskManager.Task::(_decref) Task=`f7991db3-7f46-44cd-9e00-eadd0c6a9a70`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:40:48,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:48,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0234236 s, 43.7 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:40:50,725::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:40:50,734::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000272921 s, 1.3 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:50,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:50,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370598 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:52,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:52,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310064 s, 33.0 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:40:53,004::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:40:53,015::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000935357 s, 595 kB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:40:53,532::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:40:53,540::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000206499 s, 3.1 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:40:54,241::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:40:54,261::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.0100445 s, 36.1 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:54,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-135151::DEBUG::2014-07-14 16:40:55,038::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:40:55,040::task::595::TaskManager.Task::(_updateState) Task=`a7c9121b-d616-4abb-8082-2039e3bcb517`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:40:55,041::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:40:55,043::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:40:55,045::task::1185::TaskManager.Task::(prepare) Task=`a7c9121b-d616-4abb-8082-2039e3bcb517`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:40:55,046::task::595::TaskManager.Task::(_updateState) Task=`a7c9121b-d616-4abb-8082-2039e3bcb517`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:40:55,047::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:40:55,048::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:40:55,049::task::990::TaskManager.Task::(_decref) Task=`a7c9121b-d616-4abb-8082-2039e3bcb517`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:40:55,056::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:40:55,057::task::595::TaskManager.Task::(_updateState) Task=`5d9dbe23-f992-44b7-a6a3-6fa2999e86bc`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:40:55,059::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:40:55,062::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`662c1446-af50-4d6d-96c5-75b75601b2ab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:40:55,063::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:40:55,065::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:40:55,066::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`662c1446-af50-4d6d-96c5-75b75601b2ab`::Granted request >Thread-135152::DEBUG::2014-07-14 16:40:55,068::task::827::TaskManager.Task::(resourceAcquired) Task=`5d9dbe23-f992-44b7-a6a3-6fa2999e86bc`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:40:55,070::task::990::TaskManager.Task::(_decref) Task=`5d9dbe23-f992-44b7-a6a3-6fa2999e86bc`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:40:55,086::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341193052160', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:40:55,086::task::1185::TaskManager.Task::(prepare) Task=`5d9dbe23-f992-44b7-a6a3-6fa2999e86bc`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341193052160', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:40:55,086::task::595::TaskManager.Task::(_updateState) Task=`5d9dbe23-f992-44b7-a6a3-6fa2999e86bc`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:40:55,087::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:40:55,087::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:40:55,087::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:40:55,088::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:40:55,088::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:40:55,088::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:40:55,089::task::990::TaskManager.Task::(_decref) Task=`5d9dbe23-f992-44b7-a6a3-6fa2999e86bc`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:40:55,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.086243 s, 11.9 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:40:55,152::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [44abe31] >Thread-135151::DEBUG::2014-07-14 16:40:55,152::task::595::TaskManager.Task::(_updateState) Task=`9e8dc49a-f1aa-426b-9ab3-254b3f2e15b5`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:40:55,152::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:40:55,153::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:40:55,153::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:40:55,153::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:40:55,153::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:40:55,153::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:40:55,153::task::1185::TaskManager.Task::(prepare) Task=`9e8dc49a-f1aa-426b-9ab3-254b3f2e15b5`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:40:55,154::task::595::TaskManager.Task::(_updateState) Task=`9e8dc49a-f1aa-426b-9ab3-254b3f2e15b5`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:40:55,154::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:40:55,154::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:40:55,154::task::990::TaskManager.Task::(_decref) Task=`9e8dc49a-f1aa-426b-9ab3-254b3f2e15b5`::ref 0 aborting False >Thread-11647::DEBUG::2014-07-14 16:40:55,390::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:40:55,424::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00374068 s, 149 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:57,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:57,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0252127 s, 40.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:40:59,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:40:59,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364485 s, 28.1 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:41:00,740::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:41:00,758::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.00869696 s, 41.0 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:01,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:01,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335455 s, 30.5 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:41:03,077::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:41:03,118::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.0211814 s, 26.3 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:03,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-135151::DEBUG::2014-07-14 16:41:03,345::task::595::TaskManager.Task::(_updateState) Task=`4858f8d4-5471-4bb7-a6df-0e41ce010bf4`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:41:03,347::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:41:03,350::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000206499', 'lastCheck': '9.8', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0211814', 'lastCheck': '0.2', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00869696', 'lastCheck': '2.6', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0100445', 'lastCheck': '9.1', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00374068', 'lastCheck': '7.9', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:41:03,350::task::1185::TaskManager.Task::(prepare) Task=`4858f8d4-5471-4bb7-a6df-0e41ce010bf4`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000206499', 'lastCheck': '9.8', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0211814', 'lastCheck': '0.2', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00869696', 'lastCheck': '2.6', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0100445', 'lastCheck': '9.1', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00374068', 'lastCheck': '7.9', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:41:03,352::task::595::TaskManager.Task::(_updateState) Task=`4858f8d4-5471-4bb7-a6df-0e41ce010bf4`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:41:03,353::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:41:03,354::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:41:03,355::task::990::TaskManager.Task::(_decref) Task=`4858f8d4-5471-4bb7-a6df-0e41ce010bf4`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:41:03,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0642345 s, 15.9 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:41:03,547::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:41:03,563::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000356781 s, 1.8 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:41:04,267::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:41:04,276::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.00115959 s, 313 kB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:41:05,312::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:41:05,313::task::595::TaskManager.Task::(_updateState) Task=`3eca00fa-f73e-4105-831a-1908c23828cb`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:41:05,313::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:41:05,313::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:41:05,314::task::1185::TaskManager.Task::(prepare) Task=`3eca00fa-f73e-4105-831a-1908c23828cb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:41:05,314::task::595::TaskManager.Task::(_updateState) Task=`3eca00fa-f73e-4105-831a-1908c23828cb`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:41:05,314::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:41:05,314::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:41:05,314::task::990::TaskManager.Task::(_decref) Task=`3eca00fa-f73e-4105-831a-1908c23828cb`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:41:05,318::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:41:05,318::task::595::TaskManager.Task::(_updateState) Task=`566aa265-0613-4cf1-b001-d05297697a13`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:41:05,318::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:41:05,319::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`963530e5-6644-4ff7-9fd8-bd471a18587a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:41:05,319::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:41:05,319::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:41:05,319::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`963530e5-6644-4ff7-9fd8-bd471a18587a`::Granted request >Thread-135152::DEBUG::2014-07-14 16:41:05,320::task::827::TaskManager.Task::(resourceAcquired) Task=`566aa265-0613-4cf1-b001-d05297697a13`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:41:05,320::task::990::TaskManager.Task::(_decref) Task=`566aa265-0613-4cf1-b001-d05297697a13`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:41:05,323::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341193052160', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:41:05,323::task::1185::TaskManager.Task::(prepare) Task=`566aa265-0613-4cf1-b001-d05297697a13`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341193052160', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:41:05,324::task::595::TaskManager.Task::(_updateState) Task=`566aa265-0613-4cf1-b001-d05297697a13`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:41:05,324::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:41:05,324::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:41:05,324::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:41:05,325::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:41:05,325::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:41:05,325::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:41:05,325::task::990::TaskManager.Task::(_decref) Task=`566aa265-0613-4cf1-b001-d05297697a13`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:41:05,403::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:41:05,404::task::595::TaskManager.Task::(_updateState) Task=`56019dc0-7c37-4c7b-807f-1ff7d7be2a23`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:41:05,404::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:41:05,404::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:41:05,404::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:41:05,404::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:41:05,404::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:41:05,405::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:41:05,405::task::1185::TaskManager.Task::(prepare) Task=`56019dc0-7c37-4c7b-807f-1ff7d7be2a23`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:41:05,405::task::595::TaskManager.Task::(_updateState) Task=`56019dc0-7c37-4c7b-807f-1ff7d7be2a23`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:41:05,405::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:41:05,405::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:41:05,405::task::990::TaskManager.Task::(_decref) Task=`56019dc0-7c37-4c7b-807f-1ff7d7be2a23`::ref 0 aborting False >Thread-11647::DEBUG::2014-07-14 16:41:05,430::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:05,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:41:05,447::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000200132 s, 2.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:05,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298026 s, 34.4 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:07,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:07,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282978 s, 36.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:09,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:09,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332168 s, 30.8 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:41:10,763::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:41:10,792::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.0186457 s, 19.1 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:11,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:11,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278464 s, 36.8 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:41:13,165::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:41:13,224::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.0321917 s, 17.3 kB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:41:13,582::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:41:13,599::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.00639012 s, 101 kB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:13,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:13,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303393 s, 33.8 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:41:14,282::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:41:14,315::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.02012 s, 18.0 kB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:41:15,457::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:41:15,478::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00890486 s, 62.6 kB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:41:15,565::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [27388104] >Thread-135151::DEBUG::2014-07-14 16:41:15,565::task::595::TaskManager.Task::(_updateState) Task=`ba6a33b8-64a8-4e7b-8739-826ddc085a76`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:41:15,566::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:41:15,566::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:41:15,566::task::1185::TaskManager.Task::(prepare) Task=`ba6a33b8-64a8-4e7b-8739-826ddc085a76`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:41:15,566::task::595::TaskManager.Task::(_updateState) Task=`ba6a33b8-64a8-4e7b-8739-826ddc085a76`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:41:15,566::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:41:15,567::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:41:15,567::task::990::TaskManager.Task::(_decref) Task=`ba6a33b8-64a8-4e7b-8739-826ddc085a76`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:41:15,570::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [27388104] >Thread-135152::DEBUG::2014-07-14 16:41:15,570::task::595::TaskManager.Task::(_updateState) Task=`c9fb660a-6f1e-40f7-a5f2-5d33e92c3f24`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:41:15,571::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:41:15,571::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`17fb01f0-1347-4375-a329-2da76f816557`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:41:15,571::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:41:15,572::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:41:15,572::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`17fb01f0-1347-4375-a329-2da76f816557`::Granted request >Thread-135152::DEBUG::2014-07-14 16:41:15,572::task::827::TaskManager.Task::(resourceAcquired) Task=`c9fb660a-6f1e-40f7-a5f2-5d33e92c3f24`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:41:15,572::task::990::TaskManager.Task::(_decref) Task=`c9fb660a-6f1e-40f7-a5f2-5d33e92c3f24`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:41:15,576::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341193052160', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:41:15,576::task::1185::TaskManager.Task::(prepare) Task=`c9fb660a-6f1e-40f7-a5f2-5d33e92c3f24`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3341193052160', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:41:15,576::task::595::TaskManager.Task::(_updateState) Task=`c9fb660a-6f1e-40f7-a5f2-5d33e92c3f24`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:41:15,577::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:41:15,577::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:41:15,577::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:41:15,577::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:41:15,577::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:41:15,578::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:41:15,578::task::990::TaskManager.Task::(_decref) Task=`c9fb660a-6f1e-40f7-a5f2-5d33e92c3f24`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:41:15,662::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:41:15,662::task::595::TaskManager.Task::(_updateState) Task=`5ef5c146-4d91-452e-bcdd-0eb68385db5e`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:41:15,662::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:41:15,662::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:41:15,663::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:41:15,663::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:41:15,663::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:41:15,663::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:41:15,663::task::1185::TaskManager.Task::(prepare) Task=`5ef5c146-4d91-452e-bcdd-0eb68385db5e`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:41:15,663::task::595::TaskManager.Task::(_updateState) Task=`5ef5c146-4d91-452e-bcdd-0eb68385db5e`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:41:15,664::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:41:15,664::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:41:15,664::task::990::TaskManager.Task::(_decref) Task=`5ef5c146-4d91-452e-bcdd-0eb68385db5e`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:41:15,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:15,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0532863 s, 19.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:17,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:17,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385284 s, 26.6 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:41:18,559::task::595::TaskManager.Task::(_updateState) Task=`4456b764-78af-48b0-8936-fc6b121c2e74`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:41:18,559::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:41:18,560::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00639012', 'lastCheck': '5.0', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0321917', 'lastCheck': '5.3', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0186457', 'lastCheck': '7.8', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.02012', 'lastCheck': '4.2', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00890486', 'lastCheck': '3.1', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:41:18,560::task::1185::TaskManager.Task::(prepare) Task=`4456b764-78af-48b0-8936-fc6b121c2e74`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00639012', 'lastCheck': '5.0', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0321917', 'lastCheck': '5.3', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0186457', 'lastCheck': '7.8', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.02012', 'lastCheck': '4.2', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00890486', 'lastCheck': '3.1', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:41:18,560::task::595::TaskManager.Task::(_updateState) Task=`4456b764-78af-48b0-8936-fc6b121c2e74`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:41:18,560::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:41:18,560::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:41:18,561::task::990::TaskManager.Task::(_decref) Task=`4456b764-78af-48b0-8936-fc6b121c2e74`::ref 0 aborting False >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:18,598::utils::697::Storage.Misc.excCmd::(watchCmd) SUCCESS: <err> = []; <rc> = 0 >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:18,599::volume::1111::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/401de48b-867c-4447-939f-17e5aeca6943/cb6ffbcc-603b-41a3-8977-faafe746ef92 to /rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/401de48b-867c-4447-939f-17e5aeca6943/cb6ffbcc-603b-41a3-8977-faafe746ef92_MERGE DONE >979ce810-08e8-4228-8c91-dfcf404c2a2a::INFO::2014-07-14 16:41:18,600::fileVolume::442::Storage.Volume::(rename) Rename volume cb6ffbcc-603b-41a3-8977-faafe746ef92 as _remove_me_kgBhrxwK_cb6ffbcc-603b-41a3-8977-faafe746ef92 >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:18,600::task::752::TaskManager.Task::(_save) Task=`979ce810-08e8-4228-8c91-dfcf404c2a2a`::_save: orig /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a temp /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a.temp >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:18,613::task::752::TaskManager.Task::(_save) Task=`979ce810-08e8-4228-8c91-dfcf404c2a2a`::_save: orig /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a temp /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a.temp >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:18,625::task::752::TaskManager.Task::(_save) Task=`979ce810-08e8-4228-8c91-dfcf404c2a2a`::_save: orig /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a temp /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a.temp >979ce810-08e8-4228-8c91-dfcf404c2a2a::INFO::2014-07-14 16:41:18,639::fileVolume::442::Storage.Volume::(rename) Rename volume cb6ffbcc-603b-41a3-8977-faafe746ef92_MERGE as cb6ffbcc-603b-41a3-8977-faafe746ef92 >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:18,640::task::752::TaskManager.Task::(_save) Task=`979ce810-08e8-4228-8c91-dfcf404c2a2a`::_save: orig /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a temp /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a.temp >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:18,656::task::752::TaskManager.Task::(_save) Task=`979ce810-08e8-4228-8c91-dfcf404c2a2a`::_save: orig /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a temp /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a.temp >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:18,673::task::752::TaskManager.Task::(_save) Task=`979ce810-08e8-4228-8c91-dfcf404c2a2a`::_save: orig /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a temp /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a.temp >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:18,692::task::752::TaskManager.Task::(_save) Task=`979ce810-08e8-4228-8c91-dfcf404c2a2a`::_save: orig /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a temp /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a.temp >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:18,701::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for _remove_me_kgBhrxwK_cb6ffbcc-603b-41a3-8977-faafe746ef92 >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:18,703::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for de88d34d-0ae4-4c79-8f57-14280e06fa08 >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:18,724::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for de88d34d-0ae4-4c79-8f57-14280e06fa08 >979ce810-08e8-4228-8c91-dfcf404c2a2a::INFO::2014-07-14 16:41:18,725::volume::646::Storage.Volume::(setLegality) sdUUID=965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545 imgUUID=401de48b-867c-4447-939f-17e5aeca6943 volUUID = _remove_me_kgBhrxwK_cb6ffbcc-603b-41a3-8977-faafe746ef92 legality = ILLEGAL >979ce810-08e8-4228-8c91-dfcf404c2a2a::INFO::2014-07-14 16:41:18,730::volume::646::Storage.Volume::(setLegality) sdUUID=965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545 imgUUID=401de48b-867c-4447-939f-17e5aeca6943 volUUID = de88d34d-0ae4-4c79-8f57-14280e06fa08 legality = ILLEGAL >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:18,735::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for _remove_me_kgBhrxwK_cb6ffbcc-603b-41a3-8977-faafe746ef92 >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:18,737::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for de88d34d-0ae4-4c79-8f57-14280e06fa08 >979ce810-08e8-4228-8c91-dfcf404c2a2a::INFO::2014-07-14 16:41:18,740::image::857::Storage.Image::(removeSubChain) Remove volume _remove_me_kgBhrxwK_cb6ffbcc-603b-41a3-8977-faafe746ef92 from image 401de48b-867c-4447-939f-17e5aeca6943 >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:18,743::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for de88d34d-0ae4-4c79-8f57-14280e06fa08 >979ce810-08e8-4228-8c91-dfcf404c2a2a::INFO::2014-07-14 16:41:18,745::fileVolume::166::Storage.Volume::(delete) Request to delete volume _remove_me_kgBhrxwK_cb6ffbcc-603b-41a3-8977-faafe746ef92 >979ce810-08e8-4228-8c91-dfcf404c2a2a::INFO::2014-07-14 16:41:18,745::volume::646::Storage.Volume::(setLegality) sdUUID=965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545 imgUUID=401de48b-867c-4447-939f-17e5aeca6943 volUUID = _remove_me_kgBhrxwK_cb6ffbcc-603b-41a3-8977-faafe746ef92 legality = ILLEGAL >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:18,754::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for de88d34d-0ae4-4c79-8f57-14280e06fa08 >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:18,798::utils::642::root::(execCmd) '/usr/bin/grep -E -H PUUID.*de88d34d-0ae4-4c79-8f57-14280e06fa08 /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/8fc3a359-6431-490a-8a3f-2b780f96d299/1dcb6e6c-2dc0-4724-b557-9ad21818cb8e.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/0a221e69-3b47-4e9d-8903-5957667a45e2/dfaeee82-9a0f-44de-bbb0-c81a52f18e7f.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/6c9373bc-fcdd-4db8-8b29-eb949298daa5/ac42c499-0e4b-4d7d-bff6-bab1654bc430.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/917cf06b-5473-4ef8-8e9a-529446ed8188/466dcc2f-b45b-4cfe-8b02-f4f91974fb6d.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/1b23ac73-0748-49cd-94b6-11555e35be81/55946272-817b-49dd-be9b-ad8493a4e51d.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/1b23ac73-0748-49cd-94b6-11555e35be81/bded9643-13a5-43c1-8529-20a575100baa.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/e16360ca-f172-44af-82f4-1500a34ec70a/8e77c614-5b80-4880-b3e9-cae93c40d1db.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/70dbd6a9-30aa-42d6-92d1-53a21052ea70/0ad83327-409c-4f6d-8db8-fc684b2d55c5.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/14acfe37-57c4-45a9-895c-25a560d73384/875d1550-7c74-4719-a000-6a588376c1d8.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/196158ee-2f85-4130-925f-ac8189629ff2/e0e42dc0-5b52-49c9-8d07-0caffd6b63a5.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/d5d46c05-e2f6-4258-8d2a-6194c4232ee4/051a8965-949b-43d5-b669-513a2a17d75c.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/d5d46c05-e2f6-4258-8d2a-6194c4232ee4/872614d5-feae-4bdd-a694-1cf21ae642cd.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/d5d46c05-e2f6-4258-8d2a-6194c4232ee4/6ba2c67b-8d93-41e7-b731-9ba906bf6cc9.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/d5d46c05-e2f6-4258-8d2a-6194c4232ee4/598be9c8-3130-4af0-9411-40cc3f7ee150.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/68ecbf3d-c3f9-4d3e-863f-bfd7499a66aa/fd26842c-a064-4f06-a224-7732208b5bb7.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/6bcbaf4c-5e16-4880-b672-ea1e9785cd4d/7871c2cd-1fcc-4706-a17a-1b206212677f.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/6bcbaf4c-5e16-4880-b672-ea1e9785cd4d/d6bd43bd-b824-4e13-a87c-4cb23cb5d23e.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/ca72ea72-f35a-405c-a290-db068eae0c38/baa6210a-f16a-4f89-aa2e-643d6af19856.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/9d137e00-c84c-4df8-86d2-ef9195717e45/4399d8d5-b7a9-49f7-a7dc-7c78dd536ddb.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/e013a840-a132-48fb-8037-9a1927202139/5cb2e028-c3da-46b5-b4e0-fb0c4f7cc79c.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/e013a840-a132-48fb-8037-9a1927202139/0d57d6c1-f025-4c8c-883a-acbee765c2a8.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/943d72e7-e10f-4c1c-ad18-50b51b26a2c6/c0fab6ef-05fe-4870-bc27-56ae8575308d.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/5a85fd44-24f5-43b6-b91c-eca7592ac022/682c36a0-2784-4a14-a424-da2e2d6570c2.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/f010348d-5ee0-406b-a368-9e3920f69474/f1470a5d-965b-45b1-a989-28522a631fbb.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/422a4486-6642-41ae-bb1d-b6a955550689/26b4c1e3-faf8-4fb3-b662-da6a55a3d8f2.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/4096aa3d-314f-4b4b-925d-b799a7d82b06/b0b60349-9e88-42de-9dd0-ac405457911a.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/83476528-e5bc-4ad1-86ed-aa1d516654cf/fea776bb-dc5e-4467-a1ad-8a277b517e30.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/83476528-e5bc-4ad1-86ed-aa1d516654cf/cfb6f7f1-e444-4706-9bb9-4f0127af2f38.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/4de8a935-63b2-4dce-96f4-82e3fb91f91c/100bc4c9-b301-4221-90af-0ee63814425e.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/99a606d0-490a-4558-b4e1-435963155802/56656ee7-ed60-48d8-b948-a1cbfacde0dc.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/a3d0846d-c962-4f12-81f2-665041dbacdd/ef761f41-6f6b-4a05-acff-3444c122e744.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/39c19836-81ca-4ae6-af71-282cbb629ba3/a7647e33-daf8-42d1-b7c1-e3e396725cd9.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/a5f3bc32-b18c-402e-9760-75da28229a2f/bb4744ff-41d4-4723-bba3-3decb48a4f47.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/aa1935f4-48ec-48c4-af74-0b0e49fea7ac/31cb6de6-36c9-45fb-a95f-31727277c9ac.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/51ab2254-e26a-4b7a-99dd-b401a5618775/2df3a17b-9119-4aca-8669-8836a4530c2a.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/04f9dadf-0373-4d50-920a-d9ebfb169889/56f9fcbb-9ec4-4246-9ac9-22fc14d314db.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/3669524c-dc64-4671-9c30-d561887448ef/84231eab-5a46-460f-8147-ab791abdcbc1.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/6aedcd59-f568-4921-99b1-5cface399515/8997a82d-86cb-4d54-b204-dc6ba42ced6e.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/6aedcd59-f568-4921-99b1-5cface399515/24eede0c-99bb-4159-8adc-75e885c1c902.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/a6dfd84a-24b5-42f3-855e-79dac1e9e268/8cec6391-3095-44ad-bcb5-2d459e9fe521.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/a0a37d8a-9715-41e4-b39a-1d34c49ccd8d/a0da8796-689b-435f-81c2-1c77d92902c9.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/d7011642-0f61-4b19-ab20-8d87845ef3a8/0d3be995-35e4-4e35-9cbd-599191173fc0.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/df4b342e-99f0-468a-af0c-fc10ceda27e5/9cf967fb-080e-42fb-99eb-b41c57054a7c.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/f9759a15-79cf-4783-b9aa-d2b9d0cc4a5d/46c75c3d-840e-4594-8c41-2ea44404535f.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/f9759a15-79cf-4783-b9aa-d2b9d0cc4a5d/52295471-55e7-49b1-ad06-69bd8329defc.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/165c9d12-a579-449b-b91e-58ffb78c1564/dc8b6e6f-f1c1-4c12-a699-d0573f39e31e.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/165c9d12-a579-449b-b91e-58ffb78c1564/01eba43d-4486-4b89-869d-d3394a658656.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/8cd04308-2c43-4e16-a546-7bb7cd3811aa/c14bf334-dbcc-482c-95f9-15c15e946071.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/8cd04308-2c43-4e16-a546-7bb7cd3811aa/526e421c-fc4a-4490-a4fa-d82c996bd011.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/95d0ec4c-91a6-43d9-8246-e812a07a465b/09a390de-550a-40ac-bea0-fce44cada196.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/0ad8693d-4126-42de-8877-28b7cce520fc/d4d187dc-437b-43d9-b3bc-d9cf3877be35.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/2877a377-2be2-433b-8af3-6535da751c6e/a6e75d66-0901-4b75-83c0-e6497dfffc7e.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/006c5915-c19d-48de-9ba2-156c7ccd7f9b/15dfd84e-d45b-4110-9aa4-c842e19b04e8.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/72a5cfee-aa6c-4ad4-b112-f14b531645e8/99e244af-afd5-450e-be23-b8dbb37b4fbc.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/b10e9a05-1d8d-4b52-a97a-52e49505038d/288a7234-e784-4e69-966a-b71a280d0a5c.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/2a96b756-0aa6-42b4-ae43-13efa2ecc6bb/c92fbd7b-cb2c-480b-8a00-9e5484310af8.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/d32b9190-1da9-40d6-bed7-88901c636baf/901cafc4-dbd6-4263-8c1e-c71e342a70a7.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/34aa6304-7a3e-4271-8108-1c504215467c/89232f12-2a87-45af-814c-cc300c203b97.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/908e176d-5c72-4f5a-bdd7-8ce75bfed21a/3f0c166c-7bf6-446d-a7f4-0266831d57dd.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/129c1671-386a-4df2-bc79-e5035461cc76/caada2a1-c89e-44a9-81f8-b7545a2bc1e5.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/ae7ab08d-b16c-42ec-bac2-29d6294c5449/0ce1fc2c-034b-43b1-bf15-9721fec00fb8.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/cef24e9e-b3f2-4c7d-ba97-9914da2170e0/08c73713-98de-4bb3-bf23-3c3e68aba615.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/3359a564-4cf9-49f0-996d-6d84d213e4d3/e725e7cc-8f3f-44cd-ba4b-32ff093ba74d.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/aba9b0a0-c7d0-4bbc-b044-4f547767edc5/aa8e3980-cea6-45de-bfd5-1908686f545b.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/8bd4a0ef-896c-493e-bbb6-b62dec10d1e3/1b6c0cbe-ae23-4a5f-b4c1-eed157dfbc98.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/8f3b998b-8feb-49c0-9f65-44520f5db214/82345502-f797-4e0f-b7fe-eff515bc8af0.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/97432119-170a-459e-9a91-6651d084def4/9e57616e-df4a-4212-bf97-426de6f0c5cc.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/c8f5396f-4a6d-4e4e-9df3-7f28e5baaffe/a6125dda-5a75-497e-9e14-1b3dbd6d5bae.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/ecff08ba-f3d1-4f4a-9023-ad243eecca8f/762b1b9e-d328-4475-91fb-62a47594e5af.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/15188019-16bf-4a93-930e-4e82e02e7c99/a43292c9-0609-43ae-90f7-eda6892e33f5.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/22cc5443-b180-4829-9a31-53939f6ab71e/f47af89e-6590-4d98-8a69-bf0afdb9ed23.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/b32d2140-bfe1-4de4-a0fa-ee80550e4c94/3674a39f-2502-484f-8da9-ae69a777c408.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/a99d8078-131d-4730-91d2-dc578fdd3771/9565c64a-ed51-47e3-888a-0e1996d7ac9a.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/f9c23b00-b2e8-4a5a-8949-dad5f114405b/78b7fe11-f25a-4aea-b72a-125f8202608d.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/f9c23b00-b2e8-4a5a-8949-dad5f114405b/4fdeeeaa-6c88-409a-9ef6-bce79a64a06a.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/ceaab1d7-8422-4dfb-890c-dc6e4fd63ace/b1acff48-7bc2-4364-8621-4493bf6623a2.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/3f150236-bf6b-458a-b9ba-a1414047c35c/4c739527-bd45-4e46-9bea-733fccf47e74.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/dd774c8a-dba0-4cf4-9814-209598fef062/acb74bbd-fe16-46a6-9b06-6d5e3eb11ca2.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/ec8f6c41-43b0-41c0-bfce-398a87716ae6/6f431878-8ba8-49af-a2b9-e6bb1ee5c0b7.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/81ca68a4-5e4c-4c83-8164-8238d6d6386d/5d8ec973-9053-4820-b90a-ed075b011006.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/b202cb7c-9472-4923-a5fc-e56e1845f603/b2e99955-7682-4cb2-b4b1-071f7d71a1b6.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/24f54869-9d72-47f7-92ce-9bdcbc9f1f6c/850d86e0-4593-47d0-9de0-2fc4fc1f42bf.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/24f54869-9d72-47f7-92ce-9bdcbc9f1f6c/0e9924ea-3b66-4ba2-8b3e-17bd84d1933e.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/0d8b2023-e02e-44a5-9ca4-2f5aa975f1a4/19203cfe-7f91-4b8a-89d6-1351af6f3c05.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/6e13fb73-3ee4-4d13-a3b5-73be01fb5e33/0a16038a-ac4e-44b4-9cd5-7b569ce2d6d1.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/9ab002bc-4b27-4ef1-8fa9-f9b6e2231061/cbd67197-7cb3-485a-96f5-94757f5cc6b1.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/4da3e027-ee25-4487-b110-a68ecff8a432/310f4168-4d31-48dd-a3c0-97090c5ac91d.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/a1de4c51-65f5-4878-852f-0d0934be6658/730fc300-fcc4-4272-8880-96f0e81989dd.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/6ed7ee39-63da-4376-b301-dbf679506c8e/3fff7e2d-72cd-4d42-9748-9ea5b38b891a.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/8a5c938b-5695-4f36-9e11-29a1317396e5/6c22437b-04fd-4485-a78f-61085567c3c2.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/4263e240-555c-4187-b5de-8123010756ad/8ae64407-4836-40e4-ac0c-70c8cd6d0a2f.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/f2132f99-775c-4943-93e6-a56a9f42bf30/08d14339-d111-4eee-a91e-bbae2f681c52.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/4930853a-4a44-4a08-970a-03da5a6fb528/d1608155-52ad-4918-b2cd-390b2b472208.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/7e1fa632-1550-414a-8e4e-2e43975c51f2/f3fecc79-a846-4198-a249-c24174c63001.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/b17ed883-39a0-40c6-8161-340d94c7e873/4751efbf-70dd-46c0-8190-1c7121db42b3.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/b178e129-8a21-4b72-909c-a5f5a3b9cc77/870e1a66-fc37-4b97-bb84-e3edca2745b2.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/9fac0da6-a933-4b09-ab76-24afbdde639a/6b5e2755-b321-4b28-8f2b-b86a00dd3254.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/9b911aa2-f2e0-4da8-b049-ada092ea074f/2e058586-88d4-429b-a046-0bb462e429a5.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/cd47685f-faa5-4a29-b5db-156a745dc74b/1c899cdc-be30-4685-b4a3-12e962532db6.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/5074bdee-d2ff-49e2-9361-7e00a9c76cfc/7088dffa-5272-40f4-a846-dc7ae32f6c51.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/d528c30f-d2ec-4595-b9eb-638e3bd41e36/5814cd9f-7f11-4664-94c2-4a7a0c486fbd.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/3c82b4bc-a4ff-4491-9441-3d9cfc096562/7e6469ce-45da-4efd-a39f-5ef7a1c58569.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/c7590ac7-8ba6-4738-9909-0267c21a056c/6471d8f5-4f6d-419a-8432-7ec2c0dc46ae.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/e74a14d7-3400-47d3-901b-b64e3a9118a4/7aac8b54-dad9-4e47-89fa-68b769ea5435.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/0bdf0a1e-205d-423e-9487-d95697f4c39b/98ea0bb4-cea0-41fc-80b5-8d89664e7c06.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/64c167c7-e1fe-4691-b229-ff12d4936402/279eaab9-56bc-41b6-b7fd-824adaeed7a2.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/7585d88a-c037-453d-97cf-f2f7ed566869/45fbb5ef-2f95-482c-970d-9513ad6262ff.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/127ced86-2bc7-4a06-8f0d-991b459634e5/24760cfa-9e10-4375-b481-eb3332fe3fcd.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/bf046710-dfdc-44fe-b170-81795e681792/4ee84627-7660-49bb-9ab0-8d9897d736cd.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/f76e5a35-dd5b-4f5c-983a-69554bee67cf/a9d1fa25-3fff-473a-80c1-c495f1081f97.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/12843faf-ebbc-4732-b4e9-0bb2501c194f/e579981e-3bfd-40ae-b7bf-7bf7d1383f2b.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/be5e24e1-35bf-4011-a604-52a4c6f4cc0a/e639769d-65af-4a5f-bf33-26ef95db01b9.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/be5e24e1-35bf-4011-a604-52a4c6f4cc0a/3da04daf-0d68-439a-86a4-2b582e52b19a.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/c1308071-7034-4439-a1fc-8eaae02f058a/da1ea49e-0862-48f9-9e70-3680c957c2f9.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/c1308071-7034-4439-a1fc-8eaae02f058a/f7f50a90-ad1b-4927-92d9-ad305037b8df.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/eb3a52df-a2f0-495f-8081-d0d8bcd2edae/8b030a8b-19d1-446f-a356-a216839f2a37.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/eb3a52df-a2f0-495f-8081-d0d8bcd2edae/2a75210c-aff8-47fd-8d47-757e16d495f2.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/95dc304b-afea-4c10-ba8f-e9d4db525516/dc9ebcb5-cba9-4ce2-b647-7eb7e27d5f34.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/710695c7-6ce5-411a-8282-5612d0cdb850/d821824d-afe3-4ecd-a0c8-da355c937975.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/b65d4711-e0b8-4efb-83e0-5bf7c6dcff6b/3b69924c-761e-49ca-9fdd-c0c53da3d64d.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/46caa0c5-9d5e-4ca8-bf00-cb553f9d47cb/726d32c7-2fe4-41d1-89ae-c552e8a543a0.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/48afa901-d836-43a4-a187-cf76c8afe426/a6b982e1-679b-4de8-bbee-e78230149576.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/5070be3b-8bb1-4b75-bcdf-b8bca11b1480/3b22791b-88dd-4b65-912e-f89fee9c9ab9.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/f4eef629-e378-43da-9b13-730778e7fcd4/3d046718-0058-4b0c-a2e1-dcfcbd202e7d.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/fae16e83-453f-4f9a-870f-aa6a59f7fa66/ea637c93-5714-498b-99f2-5d3bf0926b13.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/19bcc784-d884-4ade-9cef-2887b361b130/0e42305b-e1c9-47e4-b5dd-69a9926d00e1.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/19bcc784-d884-4ade-9cef-2887b361b130/26c65efb-bfba-4df3-8ae5-949c3f85336e.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/85f93535-fc44-47ed-b4ce-c54347ba9827/48c079e2-e903-4e1b-9c5f-745ab8abf749.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/c526d2f3-8b18-4bdf-83c0-a0bc95eb2f4f/d20cb348-450a-45b8-bfa6-1f711b62811f.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/ba5f303d-5d6f-4551-b90b-138d9cd969a3/f9f60e22-2e72-4496-b66c-a811713459a8.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/59de1efc-2457-4720-83b4-2febed26ffa2/854a41a4-dbbb-4e53-bbae-09811bdcfaa5.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/945db452-7e7b-4650-a03d-79f3d414b8ff/410055bb-c65b-4919-b4ac-70d12a36256b.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/d9fdec21-0218-4a27-9766-8f757f1c1f42/bd8e0c92-b6a2-47c3-988c-8ba7eee253a2.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/ccb9d1cd-6543-4efc-9b23-d7da25d9c091/03e8a65b-73a8-4373-a31d-37c7f6997d32.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/b384082f-55ce-4962-92e0-a2711a76fed3/02625d81-1775-4962-8b97-565003459c81.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/5b73512e-949b-4576-8048-e309ebce32c9/d9d8a01b-a30d-49b5-a2c1-c1d3ca74fd33.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/7efc8207-71d5-49de-9ff8-ef564279d140/1aa12c07-dea4-4277-9671-72f54e497bb6.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/eb093961-da95-4408-b841-4878743f3a37/318f8974-673d-4a0c-92dc-b2781ad44e60.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/010e607f-a7be-4f2c-b26b-2d35835d8c87/6e622d4c-e985-4eb7-be08-78e429341d23.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/65a4e5c7-fa08-4672-bc97-58073744aaa7/e412a0b9-257a-436d-af2b-04d895293cb8.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/c208dcd5-c731-4d59-af34-3f7d520a8e4b/926b4fcf-5f9e-4226-81a4-a319d3ffd3a3.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/e4fd544d-067f-484d-a227-14571ede74da/20cfecb4-eae1-4d96-83aa-51c253387410.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/c9b19024-c1f1-400b-8052-f75e7913764c/47aebb62-f5dc-4d42-bf07-d1ea13ec9435.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/1028fda7-f854-4def-8ea8-4b28e2ff1b5a/3e176f22-8b44-43c5-bb3a-682d6a448a83.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/3129b139-dca4-49c3-acaf-cc55fa404f58/377b406e-bbca-4b89-b23e-4902e48ba733.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/59d0f9e5-2816-4d81-a999-85e1070c2c49/bb7a254e-9ca5-4215-93bb-01094633f2ad.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/dc09507a-c584-41ad-80c4-f7ae5b2c3af5/547e82e3-dc86-4fb6-baf1-b68afba9491e.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/ffcfe7eb-afbf-45ea-bc93-4e57204038d3/069189ca-2b72-401c-b8b5-6a06a6fe5ba2.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/939f4737-e1d0-44a2-81de-ad57ed05a0fb/3989eac0-8af9-472d-ac67-51032d9d5c71.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/6041dae9-4872-488d-809b-e98159f9e4d8/fa748c92-71ed-438d-972b-4e23edd514bc.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/829831a5-8a8b-4bdc-b151-d36611daf01a/918cc58f-8adc-4660-a6d1-2059b2250b0b.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/a38e04c4-8c1a-48a6-aeea-fa5d92226a05/5425ac97-4bac-49b2-b32c-3c37a86e896b.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/bff1dbd5-7271-412a-9386-31f72f291db9/a56a10bc-7583-4170-9917-8a2b4fec31e3.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/3829feb8-23db-430d-8087-5acdc5249b8c/fa9439ef-9e08-47b3-8c68-cb8d4cede23c.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/095ca983-14c3-44d8-930e-fe3b798f187c/8e8e21c1-ef87-4c96-a5e1-28f6168ef10d.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/401de48b-867c-4447-939f-17e5aeca6943/de88d34d-0ae4-4c79-8f57-14280e06fa08.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/401de48b-867c-4447-939f-17e5aeca6943/_remove_me_kgBhrxwK_cb6ffbcc-603b-41a3-8977-faafe746ef92.meta /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/401de48b-867c-4447-939f-17e5aeca6943/cb6ffbcc-603b-41a3-8977-faafe746ef92.meta' (cwd None) >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:19,476::utils::662::root::(execCmd) FAILED: <err> = ''; <rc> = 1 >979ce810-08e8-4228-8c91-dfcf404c2a2a::INFO::2014-07-14 16:41:19,483::image::857::Storage.Image::(removeSubChain) Remove volume de88d34d-0ae4-4c79-8f57-14280e06fa08 from image 401de48b-867c-4447-939f-17e5aeca6943 >979ce810-08e8-4228-8c91-dfcf404c2a2a::INFO::2014-07-14 16:41:19,485::fileVolume::166::Storage.Volume::(delete) Request to delete volume de88d34d-0ae4-4c79-8f57-14280e06fa08 >979ce810-08e8-4228-8c91-dfcf404c2a2a::INFO::2014-07-14 16:41:19,485::volume::646::Storage.Volume::(setLegality) sdUUID=965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545 imgUUID=401de48b-867c-4447-939f-17e5aeca6943 volUUID = de88d34d-0ae4-4c79-8f57-14280e06fa08 legality = ILLEGAL >Dummy-135145::DEBUG::2014-07-14 16:41:19,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:20,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281155 s, 36.4 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:41:20,797::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:41:20,805::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000159709 s, 2.2 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:22,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:22,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279974 s, 36.6 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:41:23,234::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:41:23,243::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000197858 s, 2.8 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:41:23,606::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:41:23,614::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.0001437 s, 4.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:24,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:24,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0227318 s, 45.0 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:41:24,320::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:41:24,329::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000181204 s, 2.0 MB/s\n'; <rc> = 0 >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,661::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for cb6ffbcc-603b-41a3-8977-faafe746ef92 >979ce810-08e8-4228-8c91-dfcf404c2a2a::INFO::2014-07-14 16:41:24,662::image::1145::Storage.Image::(merge) Merge src=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/401de48b-867c-4447-939f-17e5aeca6943/_remove_me_kgBhrxwK_cb6ffbcc-603b-41a3-8977-faafe746ef92 with dst=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/images/401de48b-867c-4447-939f-17e5aeca6943/de88d34d-0ae4-4c79-8f57-14280e06fa08 was successfully finished. >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,662::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545_imageNS.401de48b-867c-4447-939f-17e5aeca6943' >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,662::resourceManager::635::ResourceManager::(releaseResource) Released resource '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545_imageNS.401de48b-867c-4447-939f-17e5aeca6943' (0 active users) >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,663::resourceManager::641::ResourceManager::(releaseResource) Resource '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545_imageNS.401de48b-867c-4447-939f-17e5aeca6943' is free, finding out if anyone is waiting for it. >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,663::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545_volumeNS.cb6ffbcc-603b-41a3-8977-faafe746ef92' >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,663::resourceManager::635::ResourceManager::(releaseResource) Released resource '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545_volumeNS.cb6ffbcc-603b-41a3-8977-faafe746ef92' (0 active users) >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,663::resourceManager::641::ResourceManager::(releaseResource) Resource '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545_volumeNS.cb6ffbcc-603b-41a3-8977-faafe746ef92' is free, finding out if anyone is waiting for it. >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,663::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545_volumeNS.cb6ffbcc-603b-41a3-8977-faafe746ef92', Clearing records. >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,664::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545_volumeNS.de88d34d-0ae4-4c79-8f57-14280e06fa08' >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,664::resourceManager::635::ResourceManager::(releaseResource) Released resource '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545_volumeNS.de88d34d-0ae4-4c79-8f57-14280e06fa08' (0 active users) >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,664::resourceManager::641::ResourceManager::(releaseResource) Resource '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545_volumeNS.de88d34d-0ae4-4c79-8f57-14280e06fa08' is free, finding out if anyone is waiting for it. >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,664::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545_volumeNS.de88d34d-0ae4-4c79-8f57-14280e06fa08', Clearing records. >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,664::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545_imageNS.401de48b-867c-4447-939f-17e5aeca6943', Clearing records. >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,665::task::595::TaskManager.Task::(_updateState) Task=`979ce810-08e8-4228-8c91-dfcf404c2a2a`::moving from state running -> state finished >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,665::task::752::TaskManager.Task::(_save) Task=`979ce810-08e8-4228-8c91-dfcf404c2a2a`::_save: orig /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a temp /rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/master/tasks/979ce810-08e8-4228-8c91-dfcf404c2a2a.temp >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,674::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': < ResourceRef 'Storage.965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545', isValid: 'True' obj: 'None'>} >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,674::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,674::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545' >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,674::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545' (0 active users) >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,675::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545' is free, finding out if anyone is waiting for it. >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,675::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545', Clearing records. >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,675::task::913::TaskManager.Task::(_runJobs) Task=`979ce810-08e8-4228-8c91-dfcf404c2a2a`::Task.run: exit - success: result >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,675::task::990::TaskManager.Task::(_decref) Task=`979ce810-08e8-4228-8c91-dfcf404c2a2a`::ref 0 aborting False >979ce810-08e8-4228-8c91-dfcf404c2a2a::DEBUG::2014-07-14 16:41:24,675::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-11647::DEBUG::2014-07-14 16:41:25,485::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:41:25,493::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000195309 s, 2.9 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:41:25,864::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:41:25,865::task::595::TaskManager.Task::(_updateState) Task=`c49af88f-13a5-4d16-955f-514c7cf2fb70`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:41:25,865::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:41:25,865::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:41:25,865::task::1185::TaskManager.Task::(prepare) Task=`c49af88f-13a5-4d16-955f-514c7cf2fb70`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:41:25,866::task::595::TaskManager.Task::(_updateState) Task=`c49af88f-13a5-4d16-955f-514c7cf2fb70`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:41:25,866::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:41:25,866::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:41:25,866::task::990::TaskManager.Task::(_decref) Task=`c49af88f-13a5-4d16-955f-514c7cf2fb70`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:41:25,870::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:41:25,870::task::595::TaskManager.Task::(_updateState) Task=`967d3eef-3536-40fb-a17f-09a43d3d9d07`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:41:25,870::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:41:25,871::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`c52e08f5-9557-46ac-ba69-fb751292fa00`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:41:25,871::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:41:25,871::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:41:25,871::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`c52e08f5-9557-46ac-ba69-fb751292fa00`::Granted request >Thread-135152::DEBUG::2014-07-14 16:41:25,872::task::827::TaskManager.Task::(resourceAcquired) Task=`967d3eef-3536-40fb-a17f-09a43d3d9d07`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:41:25,872::task::990::TaskManager.Task::(_decref) Task=`967d3eef-3536-40fb-a17f-09a43d3d9d07`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:41:25,875::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3416371757056', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:41:25,875::task::1185::TaskManager.Task::(prepare) Task=`967d3eef-3536-40fb-a17f-09a43d3d9d07`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3416371757056', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:41:25,876::task::595::TaskManager.Task::(_updateState) Task=`967d3eef-3536-40fb-a17f-09a43d3d9d07`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:41:25,876::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:41:25,876::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:41:25,876::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:41:25,876::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:41:25,877::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:41:25,877::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:41:25,877::task::990::TaskManager.Task::(_decref) Task=`967d3eef-3536-40fb-a17f-09a43d3d9d07`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:41:25,954::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [61dfb822] >Thread-135151::DEBUG::2014-07-14 16:41:25,954::task::595::TaskManager.Task::(_updateState) Task=`2b704192-fd03-4f16-abba-6f09c2076969`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:41:25,954::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:41:25,954::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-135151::DEBUG::2014-07-14 16:41:25,954::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:41:25,955::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'} >Thread-135151::DEBUG::2014-07-14 16:41:25,955::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}} >Thread-135151::INFO::2014-07-14 16:41:25,955::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:41:25,955::task::1185::TaskManager.Task::(prepare) Task=`2b704192-fd03-4f16-abba-6f09c2076969`::finished: {'allTasksStatus': {'979ce810-08e8-4228-8c91-dfcf404c2a2a': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '979ce810-08e8-4228-8c91-dfcf404c2a2a'}}} >Thread-135151::DEBUG::2014-07-14 16:41:25,955::task::595::TaskManager.Task::(_updateState) Task=`2b704192-fd03-4f16-abba-6f09c2076969`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:41:25,955::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:41:25,956::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:41:25,956::task::990::TaskManager.Task::(_decref) Task=`2b704192-fd03-4f16-abba-6f09c2076969`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:41:26,048::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] flowID [13af6986] >Thread-135152::DEBUG::2014-07-14 16:41:26,049::task::595::TaskManager.Task::(_updateState) Task=`d4741742-2e3f-490e-882f-d29855cb8e40`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:41:26,049::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545', spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', imgUUID='401de48b-867c-4447-939f-17e5aeca6943', volUUID='cb6ffbcc-603b-41a3-8977-faafe746ef92', options=None) >Thread-135152::DEBUG::2014-07-14 16:41:26,049::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545`ReqID=`f08e166f-3440-4f1a-b804-91c99ade1f70`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3089' at 'getVolumeInfo' >Thread-135152::DEBUG::2014-07-14 16:41:26,049::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:41:26,050::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:41:26,050::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545`ReqID=`f08e166f-3440-4f1a-b804-91c99ade1f70`::Granted request >Thread-135152::DEBUG::2014-07-14 16:41:26,050::task::827::TaskManager.Task::(resourceAcquired) Task=`d4741742-2e3f-490e-882f-d29855cb8e40`::_resourcesAcquired: Storage.965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545 (shared) >Thread-135152::DEBUG::2014-07-14 16:41:26,050::task::990::TaskManager.Task::(_decref) Task=`d4741742-2e3f-490e-882f-d29855cb8e40`::ref 1 aborting False >Thread-135152::DEBUG::2014-07-14 16:41:26,052::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for cb6ffbcc-603b-41a3-8977-faafe746ef92 >Thread-135152::INFO::2014-07-14 16:41:26,053::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545 imgUUID=401de48b-867c-4447-939f-17e5aeca6943 volUUID = cb6ffbcc-603b-41a3-8977-faafe746ef92 >Thread-135152::INFO::2014-07-14 16:41:26,062::volume::909::Storage.Volume::(getInfo) 965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/401de48b-867c-4447-939f-17e5aeca6943/cb6ffbcc-603b-41a3-8977-faafe746ef92 info is {'status': 'OK', 'domain': '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': '401de48b-867c-4447-939f-17e5aeca6943', 'ctime': '1405348555', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1405348555', 'apparentsize': '75161927680', 'children': [], 'pool': '', 'capacity': '75161927680', 'uuid': 'cb6ffbcc-603b-41a3-8977-faafe746ef92', 'truesize': '28919816192', 'type': 'PREALLOCATED'} >Thread-135152::INFO::2014-07-14 16:41:26,062::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': '401de48b-867c-4447-939f-17e5aeca6943', 'ctime': '1405348555', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1405348555', 'apparentsize': '75161927680', 'children': [], 'pool': '', 'capacity': '75161927680', 'uuid': 'cb6ffbcc-603b-41a3-8977-faafe746ef92', 'truesize': '28919816192', 'type': 'PREALLOCATED'}} >Thread-135152::DEBUG::2014-07-14 16:41:26,062::task::1185::TaskManager.Task::(prepare) Task=`d4741742-2e3f-490e-882f-d29855cb8e40`::finished: {'info': {'status': 'OK', 'domain': '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': '401de48b-867c-4447-939f-17e5aeca6943', 'ctime': '1405348555', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1405348555', 'apparentsize': '75161927680', 'children': [], 'pool': '', 'capacity': '75161927680', 'uuid': 'cb6ffbcc-603b-41a3-8977-faafe746ef92', 'truesize': '28919816192', 'type': 'PREALLOCATED'}} >Thread-135152::DEBUG::2014-07-14 16:41:26,062::task::595::TaskManager.Task::(_updateState) Task=`d4741742-2e3f-490e-882f-d29855cb8e40`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:41:26,062::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': < ResourceRef 'Storage.965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:41:26,063::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:41:26,063::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545' >Thread-135152::DEBUG::2014-07-14 16:41:26,063::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:41:26,063::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:41:26,063::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:41:26,064::task::990::TaskManager.Task::(_decref) Task=`d4741742-2e3f-490e-882f-d29855cb8e40`::ref 0 aborting False >Thread-135151::DEBUG::2014-07-14 16:41:26,112::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:41:26,112::task::595::TaskManager.Task::(_updateState) Task=`d6009548-148e-40c2-850f-5019b8b988bc`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:41:26,113::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='979ce810-08e8-4228-8c91-dfcf404c2a2a', spUUID=None, options=None) >Thread-135151::DEBUG::2014-07-14 16:41:26,113::taskManager::161::TaskManager::(clearTask) Entry. taskID: 979ce810-08e8-4228-8c91-dfcf404c2a2a >Thread-135151::DEBUG::2014-07-14 16:41:26,115::taskManager::166::TaskManager::(clearTask) Return. >Thread-135151::INFO::2014-07-14 16:41:26,115::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-135151::DEBUG::2014-07-14 16:41:26,115::task::1185::TaskManager.Task::(prepare) Task=`d6009548-148e-40c2-850f-5019b8b988bc`::finished: None >Thread-135151::DEBUG::2014-07-14 16:41:26,115::task::595::TaskManager.Task::(_updateState) Task=`d6009548-148e-40c2-850f-5019b8b988bc`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:41:26,115::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:41:26,115::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:41:26,116::task::990::TaskManager.Task::(_decref) Task=`d6009548-148e-40c2-850f-5019b8b988bc`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:41:26,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:26,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279997 s, 36.6 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:28,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:28,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0228471 s, 44.8 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:30,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:30,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0232263 s, 44.1 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:41:30,810::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:41:30,818::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.00021529 s, 1.7 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:32,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:32,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029402 s, 34.8 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:41:33,248::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:41:33,256::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.00024342 s, 2.3 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:41:33,621::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:41:33,629::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000160002 s, 4.0 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:41:33,720::task::595::TaskManager.Task::(_updateState) Task=`b829d2d6-2046-4c71-85b3-31f4b2e069d1`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:41:33,720::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-07-14 16:41:33,720::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000160002', 'lastCheck': '0.1', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024342', 'lastCheck': '0.5', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00021529', 'lastCheck': '2.9', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000181204', 'lastCheck': '9.4', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000195309', 'lastCheck': '8.2', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:41:33,720::task::1185::TaskManager.Task::(prepare) Task=`b829d2d6-2046-4c71-85b3-31f4b2e069d1`::finished: {'2c51d320-88ce-4f23-8215-e15f55f66906': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000160002', 'lastCheck': '0.1', 'valid': True}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024342', 'lastCheck': '0.5', 'valid': True}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00021529', 'lastCheck': '2.9', 'valid': True}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000181204', 'lastCheck': '9.4', 'valid': True}, '272ec473-6041-42ee-bd1a-732789dd18d4': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000195309', 'lastCheck': '8.2', 'valid': True}} >Thread-135151::DEBUG::2014-07-14 16:41:33,720::task::595::TaskManager.Task::(_updateState) Task=`b829d2d6-2046-4c71-85b3-31f4b2e069d1`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:41:33,721::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:41:33,721::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:41:33,721::task::990::TaskManager.Task::(_decref) Task=`b829d2d6-2046-4c71-85b3-31f4b2e069d1`::ref 0 aborting False >Thread-11641::DEBUG::2014-07-14 16:41:34,334::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:41:34,342::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.000175926 s, 2.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:34,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:34,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284305 s, 36.0 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:41:35,499::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:41:35,507::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000193798 s, 2.9 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:41:36,094::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:41:36,094::task::595::TaskManager.Task::(_updateState) Task=`c5b09e59-9160-42b8-9cfc-3f2c54811825`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:41:36,094::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:41:36,095::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:41:36,095::task::1185::TaskManager.Task::(prepare) Task=`c5b09e59-9160-42b8-9cfc-3f2c54811825`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:41:36,095::task::595::TaskManager.Task::(_updateState) Task=`c5b09e59-9160-42b8-9cfc-3f2c54811825`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:41:36,095::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:41:36,095::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:41:36,095::task::990::TaskManager.Task::(_decref) Task=`c5b09e59-9160-42b8-9cfc-3f2c54811825`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:41:36,098::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:41:36,099::task::595::TaskManager.Task::(_updateState) Task=`b9895610-a9a5-41a1-b00c-6bdd1ce70622`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:41:36,099::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:41:36,099::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`921a6e62-b126-48fd-8803-9044d2a80044`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:41:36,099::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:41:36,099::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:41:36,100::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`921a6e62-b126-48fd-8803-9044d2a80044`::Granted request >Thread-135152::DEBUG::2014-07-14 16:41:36,100::task::827::TaskManager.Task::(resourceAcquired) Task=`b9895610-a9a5-41a1-b00c-6bdd1ce70622`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:41:36,100::task::990::TaskManager.Task::(_decref) Task=`b9895610-a9a5-41a1-b00c-6bdd1ce70622`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:41:36,103::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3416373854208', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:41:36,103::task::1185::TaskManager.Task::(prepare) Task=`b9895610-a9a5-41a1-b00c-6bdd1ce70622`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3416373854208', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:41:36,103::task::595::TaskManager.Task::(_updateState) Task=`b9895610-a9a5-41a1-b00c-6bdd1ce70622`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:41:36,104::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:41:36,104::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:41:36,104::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:41:36,104::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:41:36,104::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:41:36,104::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:41:36,105::task::990::TaskManager.Task::(_decref) Task=`b9895610-a9a5-41a1-b00c-6bdd1ce70622`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:41:36,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:36,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0233144 s, 43.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:38,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:38,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293282 s, 34.9 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:40,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:40,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0231127 s, 44.3 MB/s\n'; <rc> = 0 >Thread-11635::DEBUG::2014-07-14 16:41:40,824::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11635::DEBUG::2014-07-14 16:41:40,832::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n357 bytes (357 B) copied, 0.000231364 s, 1.5 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:42,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:42,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0234225 s, 43.7 MB/s\n'; <rc> = 0 >Thread-11634::DEBUG::2014-07-14 16:41:43,262::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.251:_var_nas1_OVirtIB/965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11634::DEBUG::2014-07-14 16:41:43,270::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000201569 s, 2.8 MB/s\n'; <rc> = 0 >Thread-11633::DEBUG::2014-07-14 16:41:43,636::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtIB/2c51d320-88ce-4f23-8215-e15f55f66906/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11633::DEBUG::2014-07-14 16:41:43,643::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n644 bytes (644 B) copied, 0.000174911 s, 3.7 MB/s\n'; <rc> = 0 >Thread-11641::DEBUG::2014-07-14 16:41:44,347::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtEXP/63041fa9-e093-4b44-b36f-f39f16d3974f/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11641::DEBUG::2014-07-14 16:41:44,356::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n363 bytes (363 B) copied, 0.00017314 s, 2.1 MB/s\n'; <rc> = 0 >Dummy-135145::DEBUG::2014-07-14 16:41:44,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:44,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285951 s, 35.8 MB/s\n'; <rc> = 0 >Thread-11647::DEBUG::2014-07-14 16:41:45,513::fileSD::259::Storage.Misc.excCmd::(getReadDelay) '/usr/bin/dd iflag=direct if=/rhev/data-center/mnt/10.10.30.252:_var_nas2_OVirtIB/272ec473-6041-42ee-bd1a-732789dd18d4/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-11647::DEBUG::2014-07-14 16:41:45,521::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n557 bytes (557 B) copied, 0.000264022 s, 2.1 MB/s\n'; <rc> = 0 >Thread-135151::DEBUG::2014-07-14 16:41:46,322::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135151::DEBUG::2014-07-14 16:41:46,322::task::595::TaskManager.Task::(_updateState) Task=`257af933-0285-4299-ab9f-c3d7eb872f41`::moving from state init -> state preparing >Thread-135151::INFO::2014-07-14 16:41:46,323::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135151::INFO::2014-07-14 16:41:46,323::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:41:46,323::task::1185::TaskManager.Task::(prepare) Task=`257af933-0285-4299-ab9f-c3d7eb872f41`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 8}} >Thread-135151::DEBUG::2014-07-14 16:41:46,323::task::595::TaskManager.Task::(_updateState) Task=`257af933-0285-4299-ab9f-c3d7eb872f41`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-07-14 16:41:46,323::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-07-14 16:41:46,324::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-07-14 16:41:46,324::task::990::TaskManager.Task::(_decref) Task=`257af933-0285-4299-ab9f-c3d7eb872f41`::ref 0 aborting False >Thread-135152::DEBUG::2014-07-14 16:41:46,328::BindingXMLRPC::251::vds::(wrapper) client [192.168.11.2] >Thread-135152::DEBUG::2014-07-14 16:41:46,329::task::595::TaskManager.Task::(_updateState) Task=`ade3041e-97c5-42e4-9147-136d19f5aed4`::moving from state init -> state preparing >Thread-135152::INFO::2014-07-14 16:41:46,329::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='94ed7a19-fade-4bd6-83f2-2cbb2f730b95', options=None) >Thread-135152::DEBUG::2014-07-14 16:41:46,329::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`06fb0ea1-cc68-4d82-84a2-7c2f2256a19b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-135152::DEBUG::2014-07-14 16:41:46,329::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' for lock type 'shared' >Thread-135152::DEBUG::2014-07-14 16:41:46,330::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free. Now locking as 'shared' (1 active user) >Thread-135152::DEBUG::2014-07-14 16:41:46,330::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95`ReqID=`06fb0ea1-cc68-4d82-84a2-7c2f2256a19b`::Granted request >Thread-135152::DEBUG::2014-07-14 16:41:46,330::task::827::TaskManager.Task::(resourceAcquired) Task=`ade3041e-97c5-42e4-9147-136d19f5aed4`::_resourcesAcquired: Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95 (shared) >Thread-135152::DEBUG::2014-07-14 16:41:46,330::task::990::TaskManager.Task::(_decref) Task=`ade3041e-97c5-42e4-9147-136d19f5aed4`::ref 1 aborting False >Thread-135152::INFO::2014-07-14 16:41:46,334::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3416373854208', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:41:46,334::task::1185::TaskManager.Task::(prepare) Task=`ade3041e-97c5-42e4-9147-136d19f5aed4`::finished: {'info': {'name': 'Collogia', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8, 'domains': 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2:Active,965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545:Active,272ec473-6041-42ee-bd1a-732789dd18d4:Active,63041fa9-e093-4b44-b36f-f39f16d3974f:Active,2c51d320-88ce-4f23-8215-e15f55f66906:Active', 'master_uuid': '2c51d320-88ce-4f23-8215-e15f55f66906', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 3}, 'dominfo': {'272ec473-6041-42ee-bd1a-732789dd18d4': {'status': 'Active', 'diskfree': '5440747339776', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '965ca3b6-4f9c-4e81-b6e8-5ed4a9e58545': {'status': 'Active', 'diskfree': '3416373854208', 'isoprefix': '', 'alerts': [], 'disktotal': '11890484838400', 'version': 3}, '2c51d320-88ce-4f23-8215-e15f55f66906': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 3}, '63041fa9-e093-4b44-b36f-f39f16d3974f': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}, 'bff3a2be-fdd9-4e37-b416-fa4ef7fafba2': {'status': 'Active', 'diskfree': '8735155027968', 'isoprefix': '/rhev/data-center/mnt/10.10.30.253:_var_nas3_OVirtISO/bff3a2be-fdd9-4e37-b416-fa4ef7fafba2/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '23682460155904', 'version': 0}}} >Thread-135152::DEBUG::2014-07-14 16:41:46,334::task::595::TaskManager.Task::(_updateState) Task=`ade3041e-97c5-42e4-9147-136d19f5aed4`::moving from state preparing -> state finished >Thread-135152::DEBUG::2014-07-14 16:41:46,335::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95': < ResourceRef 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', isValid: 'True' obj: 'None'>} >Thread-135152::DEBUG::2014-07-14 16:41:46,335::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135152::DEBUG::2014-07-14 16:41:46,335::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' >Thread-135152::DEBUG::2014-07-14 16:41:46,335::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' (0 active users) >Thread-135152::DEBUG::2014-07-14 16:41:46,335::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95' is free, finding out if anyone is waiting for it. >Thread-135152::DEBUG::2014-07-14 16:41:46,336::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.94ed7a19-fade-4bd6-83f2-2cbb2f730b95', Clearing records. >Thread-135152::DEBUG::2014-07-14 16:41:46,336::task::990::TaskManager.Task::(_decref) Task=`ade3041e-97c5-42e4-9147-136d19f5aed4`::ref 0 aborting False >Dummy-135145::DEBUG::2014-07-14 16:41:46,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/94ed7a19-fade-4bd6-83f2-2cbb2f730b95/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-135145::DEBUG::2014-07-14 16:41:46,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285395 s, 35.9 MB/s\n'; <rc> = 0
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1116558
:
914941
|
914942
|
914943
|
914944
|
917883
| 917884