Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 937921 Details for
Bug 1128824
Deactivating master storage domain is allowed while other domains are in preparing_for_maintenance status
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm.log for vt3.1
vdsm.log (text/plain), 1.47 MB, created by
Carlos Mestre González
on 2014-09-16 10:01:08 UTC
(
hide
)
Description:
vdsm.log for vt3.1
Filename:
MIME Type:
Creator:
Carlos Mestre González
Created:
2014-09-16 10:01:08 UTC
Size:
1.47 MB
patch
obsolete
>Thread-14::DEBUG::2014-09-16 10:41:36,798::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:36,798::__init__::232::IOProcess::(_processLogs) (40700) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:41:36,798::__init__::232::IOProcess::(_processLogs) (40700) Queuing response >Dummy-37::DEBUG::2014-09-16 10:41:37,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:41:37,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114138 s, 89.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:41:39,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:41:39,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114282 s, 89.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:41:41,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:41:41,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113601 s, 90.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:41:43,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:41:43,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113963 s, 89.9 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:41:44,780::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:41:44,781::task::595::Storage.TaskManager.Task::(_updateState) Task=`c31aeb13-ba80-4736-aa32-15ad074c1a15`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:41:44,782::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:41:44,794::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:41:44,794::task::1191::Storage.TaskManager.Task::(prepare) Task=`c31aeb13-ba80-4736-aa32-15ad074c1a15`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:41:44,795::task::595::Storage.TaskManager.Task::(_updateState) Task=`c31aeb13-ba80-4736-aa32-15ad074c1a15`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:41:44,795::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:41:44,795::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:41:44,796::task::993::Storage.TaskManager.Task::(_decref) Task=`c31aeb13-ba80-4736-aa32-15ad074c1a15`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:41:44,849::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:41:44,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`aad5d69f-6da8-443b-9e83-e9499d5e4f38`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:41:44,851::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:41:44,853::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`cca76a53-4746-416f-ae11-411b81148dcf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:41:44,853::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:41:44,854::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:41:44,855::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`cca76a53-4746-416f-ae11-411b81148dcf`::Granted request >Thread-38::DEBUG::2014-09-16 10:41:44,856::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`aad5d69f-6da8-443b-9e83-e9499d5e4f38`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:41:44,857::task::993::Storage.TaskManager.Task::(_decref) Task=`aad5d69f-6da8-443b-9e83-e9499d5e4f38`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:41:44,875::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:41:44,876::task::1191::Storage.TaskManager.Task::(prepare) Task=`aad5d69f-6da8-443b-9e83-e9499d5e4f38`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:41:44,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`aad5d69f-6da8-443b-9e83-e9499d5e4f38`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:41:44,877::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:41:44,878::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:41:44,879::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:41:44,880::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:41:44,881::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:41:44,881::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:41:44,882::task::993::Storage.TaskManager.Task::(_decref) Task=`aad5d69f-6da8-443b-9e83-e9499d5e4f38`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:41:46,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:41:46,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112801 s, 90.8 MB/s\n'; <rc> = 0 >Thread-47::DEBUG::2014-09-16 10:41:46,570::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 97e2f375-6db7-43a3-81ad-ebbb94f94408 >Thread-14::DEBUG::2014-09-16 10:41:46,571::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:46,571::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:46,572::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:46,572::__init__::232::IOProcess::(_processLogs) (40701) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:41:46,572::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:46,572::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:46,572::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:46,572::__init__::232::IOProcess::(_processLogs) (40702) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:41:46,572::__init__::232::IOProcess::(_processLogs) (40701) Queuing response >Thread-14::DEBUG::2014-09-16 10:41:46,573::__init__::232::IOProcess::(_processLogs) (40702) Queuing response >Thread-47::DEBUG::2014-09-16 10:41:46,574::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408 >Thread-14::DEBUG::2014-09-16 10:41:46,575::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:46,575::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:46,575::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:46,575::__init__::232::IOProcess::(_processLogs) (40703) Got request for method 'touch' >Thread-14::DEBUG::2014-09-16 10:41:46,576::__init__::232::IOProcess::(_processLogs) (40703) Queuing response >Thread-47::DEBUG::2014-09-16 10:41:46,576::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14::DEBUG::2014-09-16 10:41:46,576::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:46,577::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:46,577::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:46,577::__init__::232::IOProcess::(_processLogs) (40704) Got request for method 'readfile' >Thread-14::DEBUG::2014-09-16 10:41:46,577::__init__::232::IOProcess::(_processLogs) (40704) Queuing response >Thread-47::DEBUG::2014-09-16 10:41:46,577::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=da06caa7-b08d-4685-b49c-84565c268648', 'REMOTE_PATH=10.34.63.199:/cmg02', 'ROLE=Regular', 'SDUUID=97e2f375-6db7-43a3-81ad-ebbb94f94408', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=51581838ac1d2d1538de639f6a518c57b7d75e58'] >Thread-14::DEBUG::2014-09-16 10:41:46,578::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:46,578::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:46,578::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:46,578::__init__::232::IOProcess::(_processLogs) (40705) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:41:46,579::__init__::232::IOProcess::(_processLogs) (40705) Queuing response >Thread-14::DEBUG::2014-09-16 10:41:46,579::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:46,579::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:46,579::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:46,579::__init__::232::IOProcess::(_processLogs) (40706) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:41:46,579::__init__::232::IOProcess::(_processLogs) (40706) Queuing response >Thread-47::DEBUG::2014-09-16 10:41:46,580::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-47::INFO::2014-09-16 10:41:46,580::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 97e2f375-6db7-43a3-81ad-ebbb94f94408_imageNS already registered >Thread-47::INFO::2014-09-16 10:41:46,580::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 97e2f375-6db7-43a3-81ad-ebbb94f94408_volumeNS already registered >Thread-14::DEBUG::2014-09-16 10:41:46,580::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:46,580::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:46,580::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:46,580::__init__::232::IOProcess::(_processLogs) (40707) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:41:46,581::__init__::232::IOProcess::(_processLogs) (40707) Queuing response >Thread-47::DEBUG::2014-09-16 10:41:46,581::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:41:46,587::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000323873 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:41:46,587::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:46,587::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:46,588::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:46,588::__init__::232::IOProcess::(_processLogs) (40708) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:41:46,588::__init__::232::IOProcess::(_processLogs) (40708) Queuing response >Thread-14::DEBUG::2014-09-16 10:41:46,799::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:46,799::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:46,799::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:46,799::__init__::232::IOProcess::(_processLogs) (40709) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:41:46,799::__init__::232::IOProcess::(_processLogs) (40709) Queuing response >Thread-21::DEBUG::2014-09-16 10:41:46,800::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:41:46,805::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000398492 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:41:46,806::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:46,806::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:46,806::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:46,806::__init__::232::IOProcess::(_processLogs) (40710) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:41:46,807::__init__::232::IOProcess::(_processLogs) (40710) Queuing response >Thread-14::DEBUG::2014-09-16 10:41:46,807::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:46,807::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:46,808::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:46,808::__init__::232::IOProcess::(_processLogs) (40711) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:41:46,808::__init__::232::IOProcess::(_processLogs) (40711) Queuing response >Thread-14::DEBUG::2014-09-16 10:41:46,808::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:46,808::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:46,808::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:46,808::__init__::232::IOProcess::(_processLogs) (40712) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:41:46,809::__init__::232::IOProcess::(_processLogs) (40712) Queuing response >Thread-14::DEBUG::2014-09-16 10:41:46,809::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:46,809::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:46,809::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:46,809::__init__::232::IOProcess::(_processLogs) (40713) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:41:46,809::__init__::232::IOProcess::(_processLogs) (40713) Queuing response >Dummy-37::DEBUG::2014-09-16 10:41:48,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:41:48,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113595 s, 90.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:41:50,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:41:50,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112901 s, 90.7 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:41:50,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e0d83bd-95c1-4dca-8161-e538ea936ddb`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:41:50,314::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:41:50,314::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000323873', 'lastCheck': '3.7', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398492', 'lastCheck': '3.5', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:41:50,314::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e0d83bd-95c1-4dca-8161-e538ea936ddb`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000323873', 'lastCheck': '3.7', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398492', 'lastCheck': '3.5', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:41:50,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e0d83bd-95c1-4dca-8161-e538ea936ddb`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:41:50,314::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:41:50,314::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:41:50,314::task::993::Storage.TaskManager.Task::(_decref) Task=`0e0d83bd-95c1-4dca-8161-e538ea936ddb`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:41:52,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:41:52,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113641 s, 90.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:41:54,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:41:54,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114176 s, 89.7 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:41:55,108::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:41:55,109::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1edd615-54e0-4884-a97f-f0e60a37962c`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:41:55,109::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:41:55,120::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:41:55,121::task::1191::Storage.TaskManager.Task::(prepare) Task=`b1edd615-54e0-4884-a97f-f0e60a37962c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:41:55,121::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1edd615-54e0-4884-a97f-f0e60a37962c`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:41:55,121::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:41:55,121::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:41:55,121::task::993::Storage.TaskManager.Task::(_decref) Task=`b1edd615-54e0-4884-a97f-f0e60a37962c`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:41:55,159::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:41:55,159::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb1b6157-219e-40d9-9717-11e2366cb694`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:41:55,159::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:41:55,160::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`661d1690-e56c-4eed-8317-036080f2c212`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:41:55,160::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:41:55,160::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:41:55,160::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`661d1690-e56c-4eed-8317-036080f2c212`::Granted request >Thread-38::DEBUG::2014-09-16 10:41:55,160::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bb1b6157-219e-40d9-9717-11e2366cb694`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:41:55,160::task::993::Storage.TaskManager.Task::(_decref) Task=`bb1b6157-219e-40d9-9717-11e2366cb694`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:41:55,172::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:41:55,172::task::1191::Storage.TaskManager.Task::(prepare) Task=`bb1b6157-219e-40d9-9717-11e2366cb694`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:41:55,172::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb1b6157-219e-40d9-9717-11e2366cb694`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:41:55,173::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:41:55,173::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:41:55,173::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:41:55,173::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:41:55,173::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:41:55,173::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:41:55,173::task::993::Storage.TaskManager.Task::(_decref) Task=`bb1b6157-219e-40d9-9717-11e2366cb694`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:41:56,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:41:56,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112749 s, 90.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:41:56,589::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:56,589::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:56,589::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:56,589::__init__::232::IOProcess::(_processLogs) (40714) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:41:56,590::__init__::232::IOProcess::(_processLogs) (40714) Queuing response >Thread-47::DEBUG::2014-09-16 10:41:56,590::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:41:56,596::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000336377 s, 966 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:41:56,596::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:56,596::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:56,597::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:56,597::__init__::232::IOProcess::(_processLogs) (40715) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:41:56,597::__init__::232::IOProcess::(_processLogs) (40715) Queuing response >Thread-14::DEBUG::2014-09-16 10:41:56,810::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:56,810::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:56,810::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:56,810::__init__::232::IOProcess::(_processLogs) (40716) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:41:56,811::__init__::232::IOProcess::(_processLogs) (40716) Queuing response >Thread-21::DEBUG::2014-09-16 10:41:56,811::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:41:56,816::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000277277 s, 1.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:41:56,817::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:56,817::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:56,817::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:56,817::__init__::232::IOProcess::(_processLogs) (40717) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:41:56,817::__init__::232::IOProcess::(_processLogs) (40717) Queuing response >Thread-14::DEBUG::2014-09-16 10:41:56,818::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:56,818::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:56,818::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:56,818::__init__::232::IOProcess::(_processLogs) (40718) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:41:56,819::__init__::232::IOProcess::(_processLogs) (40718) Queuing response >Thread-14::DEBUG::2014-09-16 10:41:56,819::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:56,819::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:56,819::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:56,819::__init__::232::IOProcess::(_processLogs) (40719) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:41:56,819::__init__::232::IOProcess::(_processLogs) (40719) Queuing response >Thread-14::DEBUG::2014-09-16 10:41:56,820::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:41:56,820::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:41:56,820::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:41:56,820::__init__::232::IOProcess::(_processLogs) (40720) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:41:56,820::__init__::232::IOProcess::(_processLogs) (40720) Queuing response >Dummy-37::DEBUG::2014-09-16 10:41:58,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:41:58,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113578 s, 90.2 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:42:00,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:00,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112793 s, 90.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:42:02,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:02,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113173 s, 90.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:42:04,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:04,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112806 s, 90.8 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:42:05,282::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:42:05,283::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d7770a5-b853-4700-8bc3-99f3283e4095`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:42:05,283::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:42:05,295::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:42:05,295::task::1191::Storage.TaskManager.Task::(prepare) Task=`0d7770a5-b853-4700-8bc3-99f3283e4095`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:42:05,295::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d7770a5-b853-4700-8bc3-99f3283e4095`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:42:05,295::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:42:05,295::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:42:05,296::task::993::Storage.TaskManager.Task::(_decref) Task=`0d7770a5-b853-4700-8bc3-99f3283e4095`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:42:05,338::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:42:05,338::task::595::Storage.TaskManager.Task::(_updateState) Task=`47a66e98-e6ea-4f19-a2a6-56d93dc586f9`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:42:05,338::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:42:05,339::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`0ec60965-aa8b-4895-94a2-dd5daca36e84`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:42:05,339::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:42:05,339::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:42:05,339::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`0ec60965-aa8b-4895-94a2-dd5daca36e84`::Granted request >Thread-38::DEBUG::2014-09-16 10:42:05,339::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`47a66e98-e6ea-4f19-a2a6-56d93dc586f9`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:42:05,339::task::993::Storage.TaskManager.Task::(_decref) Task=`47a66e98-e6ea-4f19-a2a6-56d93dc586f9`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:42:05,351::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:42:05,351::task::1191::Storage.TaskManager.Task::(prepare) Task=`47a66e98-e6ea-4f19-a2a6-56d93dc586f9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:42:05,351::task::595::Storage.TaskManager.Task::(_updateState) Task=`47a66e98-e6ea-4f19-a2a6-56d93dc586f9`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:42:05,352::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:42:05,352::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:42:05,352::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:42:05,352::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:42:05,352::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:42:05,352::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:42:05,352::task::993::Storage.TaskManager.Task::(_decref) Task=`47a66e98-e6ea-4f19-a2a6-56d93dc586f9`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:42:06,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:06,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0156193 s, 65.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:42:06,598::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:06,598::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:06,598::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:06,598::__init__::232::IOProcess::(_processLogs) (40721) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:06,598::__init__::232::IOProcess::(_processLogs) (40721) Queuing response >Thread-47::DEBUG::2014-09-16 10:42:06,599::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:42:06,606::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000269732 s, 1.2 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:42:06,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7096762-b786-45bb-bb70-ac25459637e1`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-16 10:42:06,609::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-97::INFO::2014-09-16 10:42:06,609::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::DEBUG::2014-09-16 10:42:06,610::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-97::INFO::2014-09-16 10:42:06,610::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000336377', 'lastCheck': '10.0', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277277', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-09-16 10:42:06,611::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-97::DEBUG::2014-09-16 10:42:06,611::task::1191::Storage.TaskManager.Task::(prepare) Task=`c7096762-b786-45bb-bb70-ac25459637e1`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000336377', 'lastCheck': '10.0', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277277', 'lastCheck': '9.8', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:42:06,612::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7096762-b786-45bb-bb70-ac25459637e1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-16 10:42:06,612::__init__::232::IOProcess::(_processLogs) (40722) Got request for method 'statvfs' >Thread-97::DEBUG::2014-09-16 10:42:06,612::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:42:06,613::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-16 10:42:06,613::__init__::232::IOProcess::(_processLogs) (40722) Queuing response >Thread-97::DEBUG::2014-09-16 10:42:06,613::task::993::Storage.TaskManager.Task::(_decref) Task=`c7096762-b786-45bb-bb70-ac25459637e1`::ref 0 aborting False >Thread-14::DEBUG::2014-09-16 10:42:06,821::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:06,821::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:06,821::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:06,821::__init__::232::IOProcess::(_processLogs) (40723) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:06,821::__init__::232::IOProcess::(_processLogs) (40723) Queuing response >Thread-21::DEBUG::2014-09-16 10:42:06,822::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:42:06,828::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000364836 s, 1.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:42:06,828::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:06,828::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:06,829::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:06,829::__init__::232::IOProcess::(_processLogs) (40724) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:06,829::__init__::232::IOProcess::(_processLogs) (40724) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:06,829::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:06,830::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:06,830::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:06,830::__init__::232::IOProcess::(_processLogs) (40725) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:06,830::__init__::232::IOProcess::(_processLogs) (40725) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:06,830::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:06,830::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:06,830::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:06,831::__init__::232::IOProcess::(_processLogs) (40726) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:06,831::__init__::232::IOProcess::(_processLogs) (40726) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:06,831::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:06,831::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:06,831::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:06,831::__init__::232::IOProcess::(_processLogs) (40727) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:06,831::__init__::232::IOProcess::(_processLogs) (40727) Queuing response >Dummy-37::DEBUG::2014-09-16 10:42:08,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:10,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.43184 s, 715 kB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:42:12,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:12,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114436 s, 89.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:42:14,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:14,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0190999 s, 53.6 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:42:15,606::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:42:15,607::task::595::Storage.TaskManager.Task::(_updateState) Task=`d03981fe-0ce5-4f63-b780-45dfd333622e`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:42:15,607::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:42:15,620::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:42:15,620::task::1191::Storage.TaskManager.Task::(prepare) Task=`d03981fe-0ce5-4f63-b780-45dfd333622e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:42:15,620::task::595::Storage.TaskManager.Task::(_updateState) Task=`d03981fe-0ce5-4f63-b780-45dfd333622e`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:42:15,620::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:42:15,620::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:42:15,620::task::993::Storage.TaskManager.Task::(_decref) Task=`d03981fe-0ce5-4f63-b780-45dfd333622e`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:42:15,650::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:42:15,651::task::595::Storage.TaskManager.Task::(_updateState) Task=`a028c188-19e4-4115-99d7-8c70bfb03bb3`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:42:15,651::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:42:15,652::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`6cb3d146-b68d-4ccf-9e4a-1bfdd9b2de21`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:42:15,652::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:42:15,652::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:42:15,652::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`6cb3d146-b68d-4ccf-9e4a-1bfdd9b2de21`::Granted request >Thread-38::DEBUG::2014-09-16 10:42:15,652::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a028c188-19e4-4115-99d7-8c70bfb03bb3`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:42:15,652::task::993::Storage.TaskManager.Task::(_decref) Task=`a028c188-19e4-4115-99d7-8c70bfb03bb3`::ref 1 aborting False >Dummy-37::DEBUG::2014-09-16 10:42:16,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-09-16 10:42:16,618::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:16,618::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:16,618::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:16,619::__init__::232::IOProcess::(_processLogs) (40728) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:16,832::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:16,833::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:16,833::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:16,833::__init__::232::IOProcess::(_processLogs) (40729) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:16,992::__init__::232::IOProcess::(_processLogs) (40729) Queuing response >Thread-38::INFO::2014-09-16 10:42:16,993::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:42:16,994::task::1191::Storage.TaskManager.Task::(prepare) Task=`a028c188-19e4-4115-99d7-8c70bfb03bb3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:42:16,995::task::595::Storage.TaskManager.Task::(_updateState) Task=`a028c188-19e4-4115-99d7-8c70bfb03bb3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-16 10:42:16,995::__init__::232::IOProcess::(_processLogs) (40728) Queuing response >Thread-38::DEBUG::2014-09-16 10:42:16,996::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-21::DEBUG::2014-09-16 10:42:16,996::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-38::DEBUG::2014-09-16 10:42:16,996::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:42:17,005::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-21::DEBUG::2014-09-16 10:42:17,006::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000251166 s, 1.8 MB/s\n'; <rc> = 0 >Thread-38::DEBUG::2014-09-16 10:42:17,007::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-47::DEBUG::2014-09-16 10:42:17,008::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-38::DEBUG::2014-09-16 10:42:17,009::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:42:17,015::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-14::DEBUG::2014-09-16 10:42:17,015::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:17,017::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-47::DEBUG::2014-09-16 10:42:17,018::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000251451 s, 1.3 MB/s\n'; <rc> = 0 >Thread-38::DEBUG::2014-09-16 10:42:17,018::task::993::Storage.TaskManager.Task::(_decref) Task=`a028c188-19e4-4115-99d7-8c70bfb03bb3`::ref 0 aborting False >Thread-14::DEBUG::2014-09-16 10:42:17,019::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:17,021::__init__::232::IOProcess::(_processLogs) (40730) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:17,023::__init__::232::IOProcess::(_processLogs) (40730) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:17,051::__init__::232::IOProcess::(_processLogs) Receiving request... >Dummy-37::DEBUG::2014-09-16 10:42:17,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328638 s, 31.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:42:17,053::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:17,053::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:17,053::__init__::232::IOProcess::(_processLogs) (40731) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:17,054::__init__::232::IOProcess::(_processLogs) (40731) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:17,056::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:17,057::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:17,057::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:17,058::__init__::232::IOProcess::(_processLogs) (40732) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:17,058::__init__::232::IOProcess::(_processLogs) (40732) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:17,060::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:17,060::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:17,061::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:17,061::__init__::232::IOProcess::(_processLogs) (40733) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:17,062::__init__::232::IOProcess::(_processLogs) (40733) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:17,064::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:17,065::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:17,065::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:17,066::__init__::232::IOProcess::(_processLogs) (40734) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:17,067::__init__::232::IOProcess::(_processLogs) (40734) Queuing response >Dummy-37::DEBUG::2014-09-16 10:42:19,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:19,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113353 s, 90.3 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:42:21,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:21,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113639 s, 90.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:42:23,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:23,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0147863 s, 69.3 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:42:24,466::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc242eea-fcf9-410d-9bee-6b52a1faaf3f`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:42:24,466::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:42:24,466::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000251451', 'lastCheck': '7.4', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000251166', 'lastCheck': '7.4', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:42:24,466::task::1191::Storage.TaskManager.Task::(prepare) Task=`dc242eea-fcf9-410d-9bee-6b52a1faaf3f`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000251451', 'lastCheck': '7.4', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000251166', 'lastCheck': '7.4', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:42:24,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc242eea-fcf9-410d-9bee-6b52a1faaf3f`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:42:24,467::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:42:24,467::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:42:24,467::task::993::Storage.TaskManager.Task::(_decref) Task=`dc242eea-fcf9-410d-9bee-6b52a1faaf3f`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:42:25,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:25,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114214 s, 89.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:42:27,057::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:27,057::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:27,057::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:27,058::__init__::232::IOProcess::(_processLogs) (40735) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:27,058::__init__::232::IOProcess::(_processLogs) (40735) Queuing response >Thread-47::DEBUG::2014-09-16 10:42:27,058::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:42:27,064::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000356283 s, 912 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:42:27,064::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:27,065::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:27,065::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:27,065::__init__::232::IOProcess::(_processLogs) (40736) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:27,065::__init__::232::IOProcess::(_processLogs) (40736) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:27,069::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:27,069::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:27,069::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:27,069::__init__::232::IOProcess::(_processLogs) (40737) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:27,069::__init__::232::IOProcess::(_processLogs) (40737) Queuing response >Thread-21::DEBUG::2014-09-16 10:42:27,070::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:42:27,075::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000324782 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:42:27,076::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:27,076::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:27,076::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:27,076::__init__::232::IOProcess::(_processLogs) (40738) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:27,076::__init__::232::IOProcess::(_processLogs) (40738) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:27,077::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:27,077::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:27,077::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:27,077::__init__::232::IOProcess::(_processLogs) (40739) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:27,077::__init__::232::IOProcess::(_processLogs) (40739) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:27,078::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:27,078::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:27,078::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:27,078::__init__::232::IOProcess::(_processLogs) (40740) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:27,078::__init__::232::IOProcess::(_processLogs) (40740) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:27,079::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:27,079::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:27,079::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:27,079::__init__::232::IOProcess::(_processLogs) (40741) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:27,079::__init__::232::IOProcess::(_processLogs) (40741) Queuing response >Dummy-37::DEBUG::2014-09-16 10:42:27,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:27,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112923 s, 90.7 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:42:28,593::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:42:28,594::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3e6a2a0-d80c-4a08-b4c1-b600db4e1bba`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:42:28,594::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:42:28,605::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:42:28,605::task::1191::Storage.TaskManager.Task::(prepare) Task=`c3e6a2a0-d80c-4a08-b4c1-b600db4e1bba`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:42:28,605::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3e6a2a0-d80c-4a08-b4c1-b600db4e1bba`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:42:28,605::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:42:28,605::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:42:28,605::task::993::Storage.TaskManager.Task::(_decref) Task=`c3e6a2a0-d80c-4a08-b4c1-b600db4e1bba`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:42:28,636::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:42:28,636::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1c05434-a77f-4c12-807b-f0f9d73ed192`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:42:28,636::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:42:28,636::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`d4b8a518-ee24-4dec-bf17-d7d5e5d16c6a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:42:28,637::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:42:28,637::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:42:28,637::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`d4b8a518-ee24-4dec-bf17-d7d5e5d16c6a`::Granted request >Thread-38::DEBUG::2014-09-16 10:42:28,637::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d1c05434-a77f-4c12-807b-f0f9d73ed192`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:42:28,637::task::993::Storage.TaskManager.Task::(_decref) Task=`d1c05434-a77f-4c12-807b-f0f9d73ed192`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:42:28,649::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:42:28,649::task::1191::Storage.TaskManager.Task::(prepare) Task=`d1c05434-a77f-4c12-807b-f0f9d73ed192`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:42:28,649::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1c05434-a77f-4c12-807b-f0f9d73ed192`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:42:28,649::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:42:28,649::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:42:28,649::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:42:28,650::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:42:28,650::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:42:28,650::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:42:28,650::task::993::Storage.TaskManager.Task::(_decref) Task=`d1c05434-a77f-4c12-807b-f0f9d73ed192`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:42:29,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:29,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011324 s, 90.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:42:31,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:31,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112687 s, 90.9 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:42:33,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:33,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112798 s, 90.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:42:35,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:35,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112879 s, 90.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:42:37,066::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:37,066::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:37,066::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:37,067::__init__::232::IOProcess::(_processLogs) (40742) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:37,067::__init__::232::IOProcess::(_processLogs) (40742) Queuing response >Thread-47::DEBUG::2014-09-16 10:42:37,067::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:42:37,073::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000312244 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:42:37,073::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:37,074::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:37,074::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:37,074::__init__::232::IOProcess::(_processLogs) (40743) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:37,074::__init__::232::IOProcess::(_processLogs) (40743) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:37,080::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:37,080::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:37,080::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:37,080::__init__::232::IOProcess::(_processLogs) (40744) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:37,080::__init__::232::IOProcess::(_processLogs) (40744) Queuing response >Thread-21::DEBUG::2014-09-16 10:42:37,081::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:42:37,086::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000309467 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:42:37,087::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:37,087::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:37,087::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:37,087::__init__::232::IOProcess::(_processLogs) (40745) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:37,087::__init__::232::IOProcess::(_processLogs) (40745) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:37,088::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:37,088::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:37,088::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:37,088::__init__::232::IOProcess::(_processLogs) (40746) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:37,088::__init__::232::IOProcess::(_processLogs) (40746) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:37,089::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:37,089::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:37,089::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:37,089::__init__::232::IOProcess::(_processLogs) (40747) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:37,089::__init__::232::IOProcess::(_processLogs) (40747) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:37,090::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:37,090::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:37,090::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:37,090::__init__::232::IOProcess::(_processLogs) (40748) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:37,090::__init__::232::IOProcess::(_processLogs) (40748) Queuing response >Dummy-37::DEBUG::2014-09-16 10:42:37,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:37,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113196 s, 90.5 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:42:39,334::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:42:39,334::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee2ae3cd-80d9-4b0d-9452-3c19482fc6ed`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:42:39,334::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:42:39,345::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:42:39,346::task::1191::Storage.TaskManager.Task::(prepare) Task=`ee2ae3cd-80d9-4b0d-9452-3c19482fc6ed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:42:39,346::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee2ae3cd-80d9-4b0d-9452-3c19482fc6ed`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:42:39,346::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:42:39,346::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:42:39,346::task::993::Storage.TaskManager.Task::(_decref) Task=`ee2ae3cd-80d9-4b0d-9452-3c19482fc6ed`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:42:39,377::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:42:39,377::task::595::Storage.TaskManager.Task::(_updateState) Task=`2fabe883-89c8-48f9-96a5-adf4175a5b05`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:42:39,378::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:42:39,378::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`6ec0cc80-1269-4278-986d-e9daccfa9c6c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:42:39,378::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:42:39,378::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:42:39,378::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`6ec0cc80-1269-4278-986d-e9daccfa9c6c`::Granted request >Thread-38::DEBUG::2014-09-16 10:42:39,378::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2fabe883-89c8-48f9-96a5-adf4175a5b05`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:42:39,379::task::993::Storage.TaskManager.Task::(_decref) Task=`2fabe883-89c8-48f9-96a5-adf4175a5b05`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:42:39,391::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:42:39,391::task::1191::Storage.TaskManager.Task::(prepare) Task=`2fabe883-89c8-48f9-96a5-adf4175a5b05`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:42:39,391::task::595::Storage.TaskManager.Task::(_updateState) Task=`2fabe883-89c8-48f9-96a5-adf4175a5b05`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:42:39,391::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:42:39,391::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:42:39,391::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:42:39,391::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:42:39,391::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:42:39,391::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:42:39,391::task::993::Storage.TaskManager.Task::(_decref) Task=`2fabe883-89c8-48f9-96a5-adf4175a5b05`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:42:39,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:39,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115318 s, 88.8 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:42:40,373::task::595::Storage.TaskManager.Task::(_updateState) Task=`f65079ac-e00d-4bea-9872-7a7fca374703`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:42:40,373::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:42:40,374::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000312244', 'lastCheck': '3.3', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309467', 'lastCheck': '3.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:42:40,374::task::1191::Storage.TaskManager.Task::(prepare) Task=`f65079ac-e00d-4bea-9872-7a7fca374703`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000312244', 'lastCheck': '3.3', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309467', 'lastCheck': '3.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:42:40,374::task::595::Storage.TaskManager.Task::(_updateState) Task=`f65079ac-e00d-4bea-9872-7a7fca374703`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:42:40,374::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:42:40,374::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:42:40,374::task::993::Storage.TaskManager.Task::(_decref) Task=`f65079ac-e00d-4bea-9872-7a7fca374703`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:42:41,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:41,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0111407 s, 91.9 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:42:43,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:43,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112694 s, 90.9 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:42:45,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:45,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011391 s, 89.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:42:47,075::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:47,075::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:47,076::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:47,076::__init__::232::IOProcess::(_processLogs) (40749) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:47,077::__init__::232::IOProcess::(_processLogs) (40749) Queuing response >Thread-47::DEBUG::2014-09-16 10:42:47,077::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:42:47,083::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.00031041 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:42:47,084::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:47,084::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:47,084::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:47,084::__init__::232::IOProcess::(_processLogs) (40750) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:47,084::__init__::232::IOProcess::(_processLogs) (40750) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:47,091::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:47,091::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:47,091::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:47,091::__init__::232::IOProcess::(_processLogs) (40751) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:47,091::__init__::232::IOProcess::(_processLogs) (40751) Queuing response >Thread-21::DEBUG::2014-09-16 10:42:47,092::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:42:47,097::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000315759 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:42:47,098::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:47,098::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:47,098::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:47,098::__init__::232::IOProcess::(_processLogs) (40752) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:47,098::__init__::232::IOProcess::(_processLogs) (40752) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:47,099::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:47,099::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:47,099::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:47,099::__init__::232::IOProcess::(_processLogs) (40753) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:47,100::__init__::232::IOProcess::(_processLogs) (40753) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:47,100::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:47,100::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:47,100::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:47,100::__init__::232::IOProcess::(_processLogs) (40754) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:47,100::__init__::232::IOProcess::(_processLogs) (40754) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:47,101::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:47,101::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:47,101::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:47,101::__init__::232::IOProcess::(_processLogs) (40755) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:47,101::__init__::232::IOProcess::(_processLogs) (40755) Queuing response >Dummy-37::DEBUG::2014-09-16 10:42:47,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:47,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112656 s, 90.9 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:42:49,640::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:42:49,640::task::595::Storage.TaskManager.Task::(_updateState) Task=`0cc0f2c8-55d5-4f6e-aa87-57430d1d0a5e`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:42:49,640::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:42:49,652::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:42:49,652::task::1191::Storage.TaskManager.Task::(prepare) Task=`0cc0f2c8-55d5-4f6e-aa87-57430d1d0a5e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:42:49,652::task::595::Storage.TaskManager.Task::(_updateState) Task=`0cc0f2c8-55d5-4f6e-aa87-57430d1d0a5e`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:42:49,652::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:42:49,652::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:42:49,652::task::993::Storage.TaskManager.Task::(_decref) Task=`0cc0f2c8-55d5-4f6e-aa87-57430d1d0a5e`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:42:49,683::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:42:49,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`921c0cdd-0e3c-471f-99a4-01855f0ab782`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:42:49,683::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:42:49,683::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`3edf35b4-4559-4489-b545-7945d995ec9c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:42:49,683::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:42:49,684::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:42:49,684::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`3edf35b4-4559-4489-b545-7945d995ec9c`::Granted request >Thread-38::DEBUG::2014-09-16 10:42:49,684::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`921c0cdd-0e3c-471f-99a4-01855f0ab782`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:42:49,684::task::993::Storage.TaskManager.Task::(_decref) Task=`921c0cdd-0e3c-471f-99a4-01855f0ab782`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:42:49,696::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:42:49,697::task::1191::Storage.TaskManager.Task::(prepare) Task=`921c0cdd-0e3c-471f-99a4-01855f0ab782`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:42:49,697::task::595::Storage.TaskManager.Task::(_updateState) Task=`921c0cdd-0e3c-471f-99a4-01855f0ab782`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:42:49,697::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:42:49,697::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:42:49,697::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:42:49,697::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:42:49,697::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:42:49,697::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:42:49,697::task::993::Storage.TaskManager.Task::(_decref) Task=`921c0cdd-0e3c-471f-99a4-01855f0ab782`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:42:49,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:49,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113927 s, 89.9 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:42:51,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:51,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113069 s, 90.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:42:53,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:53,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117547 s, 87.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:42:55,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:56,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112911 s, 90.7 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:42:56,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8d6cb7e-ab9d-4e88-bdec-2dacf786ed5b`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:42:56,316::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:42:56,317::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00031041', 'lastCheck': '9.2', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000315759', 'lastCheck': '9.2', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:42:56,317::task::1191::Storage.TaskManager.Task::(prepare) Task=`d8d6cb7e-ab9d-4e88-bdec-2dacf786ed5b`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00031041', 'lastCheck': '9.2', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000315759', 'lastCheck': '9.2', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:42:56,317::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8d6cb7e-ab9d-4e88-bdec-2dacf786ed5b`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:42:56,317::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:42:56,317::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:42:56,317::task::993::Storage.TaskManager.Task::(_decref) Task=`d8d6cb7e-ab9d-4e88-bdec-2dacf786ed5b`::ref 0 aborting False >Thread-14::DEBUG::2014-09-16 10:42:57,085::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:57,085::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:57,085::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:57,085::__init__::232::IOProcess::(_processLogs) (40756) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:57,086::__init__::232::IOProcess::(_processLogs) (40756) Queuing response >Thread-47::DEBUG::2014-09-16 10:42:57,086::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:42:57,092::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000297965 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:42:57,092::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:57,092::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:57,093::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:57,093::__init__::232::IOProcess::(_processLogs) (40757) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:57,093::__init__::232::IOProcess::(_processLogs) (40757) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:57,102::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:57,102::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:57,102::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:57,102::__init__::232::IOProcess::(_processLogs) (40758) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:57,102::__init__::232::IOProcess::(_processLogs) (40758) Queuing response >Thread-21::DEBUG::2014-09-16 10:42:57,103::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:42:57,108::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000277605 s, 1.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:42:57,109::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:57,109::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:57,109::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:57,109::__init__::232::IOProcess::(_processLogs) (40759) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:42:57,109::__init__::232::IOProcess::(_processLogs) (40759) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:57,110::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:57,110::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:57,110::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:57,110::__init__::232::IOProcess::(_processLogs) (40760) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:57,110::__init__::232::IOProcess::(_processLogs) (40760) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:57,111::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:57,111::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:57,111::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:57,111::__init__::232::IOProcess::(_processLogs) (40761) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:57,111::__init__::232::IOProcess::(_processLogs) (40761) Queuing response >Thread-14::DEBUG::2014-09-16 10:42:57,112::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:42:57,112::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:42:57,112::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:42:57,112::__init__::232::IOProcess::(_processLogs) (40762) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:42:57,112::__init__::232::IOProcess::(_processLogs) (40762) Queuing response >Dummy-37::DEBUG::2014-09-16 10:42:58,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:42:58,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112947 s, 90.7 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:42:59,949::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:42:59,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a37bc10-7d0f-40df-8ba6-6d1353b52bf9`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:42:59,949::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:42:59,961::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:42:59,961::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a37bc10-7d0f-40df-8ba6-6d1353b52bf9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:42:59,961::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a37bc10-7d0f-40df-8ba6-6d1353b52bf9`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:42:59,961::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:42:59,961::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:42:59,961::task::993::Storage.TaskManager.Task::(_decref) Task=`9a37bc10-7d0f-40df-8ba6-6d1353b52bf9`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:42:59,991::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:42:59,992::task::595::Storage.TaskManager.Task::(_updateState) Task=`858c6f34-4dce-49fb-9ca2-aa6df4d489f1`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:42:59,993::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:42:59,994::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`f0ccb874-63fd-45f9-9507-2fcefea039da`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:42:59,994::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:42:59,995::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:42:59,995::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`f0ccb874-63fd-45f9-9507-2fcefea039da`::Granted request >Thread-38::DEBUG::2014-09-16 10:42:59,996::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`858c6f34-4dce-49fb-9ca2-aa6df4d489f1`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:42:59,996::task::993::Storage.TaskManager.Task::(_decref) Task=`858c6f34-4dce-49fb-9ca2-aa6df4d489f1`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:43:00,008::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:43:00,008::task::1191::Storage.TaskManager.Task::(prepare) Task=`858c6f34-4dce-49fb-9ca2-aa6df4d489f1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:43:00,008::task::595::Storage.TaskManager.Task::(_updateState) Task=`858c6f34-4dce-49fb-9ca2-aa6df4d489f1`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:43:00,008::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:43:00,008::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:43:00,008::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:43:00,009::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:43:00,009::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:43:00,009::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:43:00,009::task::993::Storage.TaskManager.Task::(_decref) Task=`858c6f34-4dce-49fb-9ca2-aa6df4d489f1`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:43:00,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:00,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132846 s, 77.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:43:02,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:02,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113074 s, 90.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:43:04,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:04,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0111869 s, 91.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:43:06,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:06,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0111663 s, 91.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:07,094::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:07,094::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:07,094::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:07,094::__init__::232::IOProcess::(_processLogs) (40763) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:07,094::__init__::232::IOProcess::(_processLogs) (40763) Queuing response >Thread-47::DEBUG::2014-09-16 10:43:07,095::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:43:07,101::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000323275 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:07,101::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:07,101::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:07,102::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:07,102::__init__::232::IOProcess::(_processLogs) (40764) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:07,102::__init__::232::IOProcess::(_processLogs) (40764) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:07,113::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:07,113::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:07,113::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:07,113::__init__::232::IOProcess::(_processLogs) (40765) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:07,113::__init__::232::IOProcess::(_processLogs) (40765) Queuing response >Thread-21::DEBUG::2014-09-16 10:43:07,114::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:43:07,119::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000291568 s, 1.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:07,120::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:07,120::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:07,120::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:07,120::__init__::232::IOProcess::(_processLogs) (40766) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:07,120::__init__::232::IOProcess::(_processLogs) (40766) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:07,121::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:07,121::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:07,121::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:07,122::__init__::232::IOProcess::(_processLogs) (40767) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:07,122::__init__::232::IOProcess::(_processLogs) (40767) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:07,122::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:07,122::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:07,122::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:07,122::__init__::232::IOProcess::(_processLogs) (40768) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:07,123::__init__::232::IOProcess::(_processLogs) (40768) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:07,123::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:07,123::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:07,123::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:07,123::__init__::232::IOProcess::(_processLogs) (40769) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:07,123::__init__::232::IOProcess::(_processLogs) (40769) Queuing response >Dummy-37::DEBUG::2014-09-16 10:43:08,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:08,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113321 s, 90.4 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:43:10,206::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:43:10,207::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2489524-7348-4509-a5ef-7936b697c56f`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:43:10,207::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:43:10,218::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:43:10,219::task::1191::Storage.TaskManager.Task::(prepare) Task=`c2489524-7348-4509-a5ef-7936b697c56f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:43:10,219::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2489524-7348-4509-a5ef-7936b697c56f`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:43:10,219::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:43:10,219::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:43:10,219::task::993::Storage.TaskManager.Task::(_decref) Task=`c2489524-7348-4509-a5ef-7936b697c56f`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:43:10,248::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:43:10,248::task::595::Storage.TaskManager.Task::(_updateState) Task=`1adabff0-cedb-41b5-b831-4f40561bcbac`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:43:10,249::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:43:10,249::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`c106a4dc-abd9-4389-b522-7e6d1af6ddcb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:43:10,249::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:43:10,249::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:43:10,249::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`c106a4dc-abd9-4389-b522-7e6d1af6ddcb`::Granted request >Thread-38::DEBUG::2014-09-16 10:43:10,249::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1adabff0-cedb-41b5-b831-4f40561bcbac`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:43:10,249::task::993::Storage.TaskManager.Task::(_decref) Task=`1adabff0-cedb-41b5-b831-4f40561bcbac`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:43:10,262::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:43:10,262::task::1191::Storage.TaskManager.Task::(prepare) Task=`1adabff0-cedb-41b5-b831-4f40561bcbac`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:43:10,262::task::595::Storage.TaskManager.Task::(_updateState) Task=`1adabff0-cedb-41b5-b831-4f40561bcbac`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:43:10,262::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:43:10,262::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:43:10,262::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:43:10,263::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:43:10,263::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:43:10,263::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:43:10,263::task::993::Storage.TaskManager.Task::(_decref) Task=`1adabff0-cedb-41b5-b831-4f40561bcbac`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:43:10,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:10,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113273 s, 90.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:43:12,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:12,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0111829 s, 91.6 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:43:12,432::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5c652f4-7d99-4211-ab63-8c494f537174`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:43:12,432::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:43:12,432::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000323275', 'lastCheck': '5.3', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000291568', 'lastCheck': '5.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:43:12,432::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5c652f4-7d99-4211-ab63-8c494f537174`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000323275', 'lastCheck': '5.3', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000291568', 'lastCheck': '5.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:43:12,432::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5c652f4-7d99-4211-ab63-8c494f537174`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:43:12,432::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:43:12,432::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:43:12,433::task::993::Storage.TaskManager.Task::(_decref) Task=`b5c652f4-7d99-4211-ab63-8c494f537174`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:43:14,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:14,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0201154 s, 50.9 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:43:16,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:16,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113466 s, 90.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:17,103::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:17,103::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:17,103::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:17,103::__init__::232::IOProcess::(_processLogs) (40770) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:17,104::__init__::232::IOProcess::(_processLogs) (40770) Queuing response >Thread-47::DEBUG::2014-09-16 10:43:17,104::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:43:17,109::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000315036 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:17,110::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:17,110::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:17,110::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:17,110::__init__::232::IOProcess::(_processLogs) (40771) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:17,111::__init__::232::IOProcess::(_processLogs) (40771) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:17,124::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:17,124::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:17,124::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:17,124::__init__::232::IOProcess::(_processLogs) (40772) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:17,125::__init__::232::IOProcess::(_processLogs) (40772) Queuing response >Thread-21::DEBUG::2014-09-16 10:43:17,125::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:43:17,130::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000261434 s, 1.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:17,131::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:17,131::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:17,131::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:17,131::__init__::232::IOProcess::(_processLogs) (40773) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:17,131::__init__::232::IOProcess::(_processLogs) (40773) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:17,132::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:17,132::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:17,132::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:17,132::__init__::232::IOProcess::(_processLogs) (40774) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:17,132::__init__::232::IOProcess::(_processLogs) (40774) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:17,133::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:17,133::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:17,133::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:17,133::__init__::232::IOProcess::(_processLogs) (40775) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:17,133::__init__::232::IOProcess::(_processLogs) (40775) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:17,133::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:17,134::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:17,134::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:17,134::__init__::232::IOProcess::(_processLogs) (40776) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:17,134::__init__::232::IOProcess::(_processLogs) (40776) Queuing response >Dummy-37::DEBUG::2014-09-16 10:43:18,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:18,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113338 s, 90.3 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:43:20,593::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:43:20,594::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebe3b8ee-a4f0-457a-bce3-a4e244018afd`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:43:20,594::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:43:20,605::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:43:20,605::task::1191::Storage.TaskManager.Task::(prepare) Task=`ebe3b8ee-a4f0-457a-bce3-a4e244018afd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:43:20,606::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebe3b8ee-a4f0-457a-bce3-a4e244018afd`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:43:20,606::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:43:20,606::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:43:20,606::task::993::Storage.TaskManager.Task::(_decref) Task=`ebe3b8ee-a4f0-457a-bce3-a4e244018afd`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:43:20,638::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:43:20,639::task::595::Storage.TaskManager.Task::(_updateState) Task=`f707e4b7-dfdf-4222-b004-ac6cd70b2ff3`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:43:20,639::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:43:20,639::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`d927fef2-380a-4915-b1c8-867efa851697`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:43:20,639::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:43:20,640::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:43:20,640::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`d927fef2-380a-4915-b1c8-867efa851697`::Granted request >Thread-38::DEBUG::2014-09-16 10:43:20,640::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f707e4b7-dfdf-4222-b004-ac6cd70b2ff3`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:43:20,640::task::993::Storage.TaskManager.Task::(_decref) Task=`f707e4b7-dfdf-4222-b004-ac6cd70b2ff3`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:43:20,653::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:43:20,654::task::1191::Storage.TaskManager.Task::(prepare) Task=`f707e4b7-dfdf-4222-b004-ac6cd70b2ff3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:43:20,654::task::595::Storage.TaskManager.Task::(_updateState) Task=`f707e4b7-dfdf-4222-b004-ac6cd70b2ff3`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:43:20,654::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:43:20,654::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:43:20,654::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:43:20,654::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:43:20,654::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:43:20,654::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:43:20,654::task::993::Storage.TaskManager.Task::(_decref) Task=`f707e4b7-dfdf-4222-b004-ac6cd70b2ff3`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:43:20,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:20,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113275 s, 90.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:43:22,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:22,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113192 s, 90.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:43:24,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:24,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011405 s, 89.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:43:26,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:26,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113527 s, 90.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:27,112::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:27,112::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:27,112::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:27,112::__init__::232::IOProcess::(_processLogs) (40777) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:27,112::__init__::232::IOProcess::(_processLogs) (40777) Queuing response >Thread-47::DEBUG::2014-09-16 10:43:27,113::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:43:27,118::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000287334 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:27,119::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:27,119::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:27,119::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:27,119::__init__::232::IOProcess::(_processLogs) (40778) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:27,119::__init__::232::IOProcess::(_processLogs) (40778) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:27,135::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:27,135::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:27,135::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:27,135::__init__::232::IOProcess::(_processLogs) (40779) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:27,135::__init__::232::IOProcess::(_processLogs) (40779) Queuing response >Thread-21::DEBUG::2014-09-16 10:43:27,136::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:43:27,141::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000353736 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:27,142::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:27,142::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:27,142::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:27,142::__init__::232::IOProcess::(_processLogs) (40780) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:27,142::__init__::232::IOProcess::(_processLogs) (40780) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:27,143::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:27,143::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:27,143::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:27,143::__init__::232::IOProcess::(_processLogs) (40781) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:27,143::__init__::232::IOProcess::(_processLogs) (40781) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:27,144::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:27,144::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:27,144::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:27,144::__init__::232::IOProcess::(_processLogs) (40782) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:27,144::__init__::232::IOProcess::(_processLogs) (40782) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:27,144::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:27,145::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:27,145::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:27,145::__init__::232::IOProcess::(_processLogs) (40783) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:27,145::__init__::232::IOProcess::(_processLogs) (40783) Queuing response >Thread-97::DEBUG::2014-09-16 10:43:28,022::task::595::Storage.TaskManager.Task::(_updateState) Task=`6707a6e1-c880-4b9b-85c4-ec21d8bac783`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:43:28,022::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:43:28,022::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000287334', 'lastCheck': '0.9', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353736', 'lastCheck': '0.9', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:43:28,022::task::1191::Storage.TaskManager.Task::(prepare) Task=`6707a6e1-c880-4b9b-85c4-ec21d8bac783`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000287334', 'lastCheck': '0.9', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353736', 'lastCheck': '0.9', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:43:28,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`6707a6e1-c880-4b9b-85c4-ec21d8bac783`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:43:28,023::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:43:28,023::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:43:28,023::task::993::Storage.TaskManager.Task::(_decref) Task=`6707a6e1-c880-4b9b-85c4-ec21d8bac783`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:43:28,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:28,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112794 s, 90.8 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:43:30,867::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:43:30,868::task::595::Storage.TaskManager.Task::(_updateState) Task=`b398d5f3-3ed9-400c-95dc-cbff00e2a031`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:43:30,868::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:43:30,879::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:43:30,879::task::1191::Storage.TaskManager.Task::(prepare) Task=`b398d5f3-3ed9-400c-95dc-cbff00e2a031`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:43:30,879::task::595::Storage.TaskManager.Task::(_updateState) Task=`b398d5f3-3ed9-400c-95dc-cbff00e2a031`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:43:30,879::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:43:30,879::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:43:30,879::task::993::Storage.TaskManager.Task::(_decref) Task=`b398d5f3-3ed9-400c-95dc-cbff00e2a031`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:43:30,910::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:43:30,910::task::595::Storage.TaskManager.Task::(_updateState) Task=`40cc2ba6-dc66-4ff4-bcc5-4d52ca7381c4`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:43:30,911::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:43:30,911::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`87bbb3ae-41a0-4e1f-b270-45d3439014aa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:43:30,911::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:43:30,911::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:43:30,911::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`87bbb3ae-41a0-4e1f-b270-45d3439014aa`::Granted request >Thread-38::DEBUG::2014-09-16 10:43:30,911::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`40cc2ba6-dc66-4ff4-bcc5-4d52ca7381c4`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:43:30,912::task::993::Storage.TaskManager.Task::(_decref) Task=`40cc2ba6-dc66-4ff4-bcc5-4d52ca7381c4`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:43:30,923::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:43:30,924::task::1191::Storage.TaskManager.Task::(prepare) Task=`40cc2ba6-dc66-4ff4-bcc5-4d52ca7381c4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:43:30,924::task::595::Storage.TaskManager.Task::(_updateState) Task=`40cc2ba6-dc66-4ff4-bcc5-4d52ca7381c4`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:43:30,924::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:43:30,924::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:43:30,924::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:43:30,924::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:43:30,924::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:43:30,924::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:43:30,924::task::993::Storage.TaskManager.Task::(_decref) Task=`40cc2ba6-dc66-4ff4-bcc5-4d52ca7381c4`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:43:30,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:30,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011261 s, 90.9 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:43:32,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:33,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01138 s, 90.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:43:35,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:35,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113621 s, 90.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:43:37,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:37,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112947 s, 90.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:37,126::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:37,127::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:37,127::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:37,128::__init__::232::IOProcess::(_processLogs) (40784) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:37,128::__init__::232::IOProcess::(_processLogs) (40784) Queuing response >Thread-47::DEBUG::2014-09-16 10:43:37,132::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:43:37,138::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000264756 s, 1.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:37,140::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:37,140::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:37,141::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:37,141::__init__::232::IOProcess::(_processLogs) (40785) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:37,142::__init__::232::IOProcess::(_processLogs) (40785) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:37,146::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:37,147::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:37,147::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:37,147::__init__::232::IOProcess::(_processLogs) (40786) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:37,148::__init__::232::IOProcess::(_processLogs) (40786) Queuing response >Thread-21::DEBUG::2014-09-16 10:43:37,150::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:43:37,156::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000281392 s, 1.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:37,158::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:37,159::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:37,159::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:37,160::__init__::232::IOProcess::(_processLogs) (40787) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:37,160::__init__::232::IOProcess::(_processLogs) (40787) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:37,163::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:37,163::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:37,164::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:37,164::__init__::232::IOProcess::(_processLogs) (40788) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:37,165::__init__::232::IOProcess::(_processLogs) (40788) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:37,166::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:37,167::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:37,167::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:37,167::__init__::232::IOProcess::(_processLogs) (40789) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:37,168::__init__::232::IOProcess::(_processLogs) (40789) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:37,169::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:37,170::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:37,170::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:37,171::__init__::232::IOProcess::(_processLogs) (40790) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:37,171::__init__::232::IOProcess::(_processLogs) (40790) Queuing response >Dummy-37::DEBUG::2014-09-16 10:43:39,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:39,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011431 s, 89.6 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:43:41,123::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:43:41,123::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d018940-3ad9-4760-89ce-d15a333a6f02`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:43:41,123::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:43:41,134::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:43:41,134::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d018940-3ad9-4760-89ce-d15a333a6f02`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:43:41,134::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d018940-3ad9-4760-89ce-d15a333a6f02`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:43:41,135::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:43:41,135::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:43:41,135::task::993::Storage.TaskManager.Task::(_decref) Task=`2d018940-3ad9-4760-89ce-d15a333a6f02`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:43:41,165::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:43:41,165::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f6dee15-de9c-45d5-b61c-738a792fa3b8`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:43:41,165::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:43:41,165::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`53f2a830-4c8a-481d-8fc6-891eea9e5f47`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:43:41,166::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:43:41,166::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:43:41,166::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`53f2a830-4c8a-481d-8fc6-891eea9e5f47`::Granted request >Thread-38::DEBUG::2014-09-16 10:43:41,166::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8f6dee15-de9c-45d5-b61c-738a792fa3b8`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:43:41,166::task::993::Storage.TaskManager.Task::(_decref) Task=`8f6dee15-de9c-45d5-b61c-738a792fa3b8`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:43:41,178::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:43:41,178::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f6dee15-de9c-45d5-b61c-738a792fa3b8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:43:41,178::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f6dee15-de9c-45d5-b61c-738a792fa3b8`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:43:41,179::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:43:41,179::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:43:41,179::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:43:41,179::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:43:41,179::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:43:41,179::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:43:41,179::task::993::Storage.TaskManager.Task::(_decref) Task=`8f6dee15-de9c-45d5-b61c-738a792fa3b8`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:43:41,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:41,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113223 s, 90.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:43:43,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:43,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115289 s, 88.8 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:43:44,842::task::595::Storage.TaskManager.Task::(_updateState) Task=`19239c83-2f13-4a8e-bea3-ccf8988352c0`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:43:44,843::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:43:44,843::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264756', 'lastCheck': '7.7', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000281392', 'lastCheck': '7.7', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:43:44,844::task::1191::Storage.TaskManager.Task::(prepare) Task=`19239c83-2f13-4a8e-bea3-ccf8988352c0`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264756', 'lastCheck': '7.7', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000281392', 'lastCheck': '7.7', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:43:44,844::task::595::Storage.TaskManager.Task::(_updateState) Task=`19239c83-2f13-4a8e-bea3-ccf8988352c0`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:43:44,845::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:43:44,845::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:43:44,845::task::993::Storage.TaskManager.Task::(_decref) Task=`19239c83-2f13-4a8e-bea3-ccf8988352c0`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:43:45,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:45,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113029 s, 90.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:47,145::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:47,145::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:47,145::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:47,145::__init__::232::IOProcess::(_processLogs) (40791) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:47,145::__init__::232::IOProcess::(_processLogs) (40791) Queuing response >Thread-47::DEBUG::2014-09-16 10:43:47,146::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:43:47,152::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000313545 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:47,152::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:47,153::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:47,153::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:47,153::__init__::232::IOProcess::(_processLogs) (40792) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:47,153::__init__::232::IOProcess::(_processLogs) (40792) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:47,173::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:47,173::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:47,173::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:47,173::__init__::232::IOProcess::(_processLogs) (40793) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:47,173::__init__::232::IOProcess::(_processLogs) (40793) Queuing response >Thread-21::DEBUG::2014-09-16 10:43:47,174::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:43:47,179::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000313304 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:47,180::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:47,180::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:47,180::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:47,180::__init__::232::IOProcess::(_processLogs) (40794) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:47,180::__init__::232::IOProcess::(_processLogs) (40794) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:47,181::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:47,181::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:47,181::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:47,181::__init__::232::IOProcess::(_processLogs) (40795) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:47,181::__init__::232::IOProcess::(_processLogs) (40795) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:47,182::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:47,182::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:47,182::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:47,182::__init__::232::IOProcess::(_processLogs) (40796) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:47,182::__init__::232::IOProcess::(_processLogs) (40796) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:47,183::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:47,183::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:47,183::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:47,183::__init__::232::IOProcess::(_processLogs) (40797) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:47,183::__init__::232::IOProcess::(_processLogs) (40797) Queuing response >Dummy-37::DEBUG::2014-09-16 10:43:47,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:47,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112836 s, 90.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:43:49,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:49,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113067 s, 90.6 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:43:51,308::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:43:51,308::task::595::Storage.TaskManager.Task::(_updateState) Task=`5055e4bd-a424-4ffc-ac81-c9faa1f87554`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:43:51,309::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:43:51,320::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:43:51,320::task::1191::Storage.TaskManager.Task::(prepare) Task=`5055e4bd-a424-4ffc-ac81-c9faa1f87554`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:43:51,320::task::595::Storage.TaskManager.Task::(_updateState) Task=`5055e4bd-a424-4ffc-ac81-c9faa1f87554`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:43:51,320::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:43:51,320::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:43:51,320::task::993::Storage.TaskManager.Task::(_decref) Task=`5055e4bd-a424-4ffc-ac81-c9faa1f87554`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:43:51,350::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:43:51,351::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd132348-3fad-4cdf-898e-7b112e994658`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:43:51,351::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:43:51,351::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`52acc48e-525a-4803-adfa-44429a0e9b5f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:43:51,351::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:43:51,351::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:43:51,351::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`52acc48e-525a-4803-adfa-44429a0e9b5f`::Granted request >Thread-38::DEBUG::2014-09-16 10:43:51,352::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fd132348-3fad-4cdf-898e-7b112e994658`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:43:51,352::task::993::Storage.TaskManager.Task::(_decref) Task=`fd132348-3fad-4cdf-898e-7b112e994658`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:43:51,363::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:43:51,364::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd132348-3fad-4cdf-898e-7b112e994658`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:43:51,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd132348-3fad-4cdf-898e-7b112e994658`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:43:51,364::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:43:51,364::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:43:51,364::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:43:51,364::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:43:51,364::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:43:51,364::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:43:51,364::task::993::Storage.TaskManager.Task::(_decref) Task=`fd132348-3fad-4cdf-898e-7b112e994658`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:43:51,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:51,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113091 s, 90.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:43:53,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:53,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114398 s, 89.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:43:55,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:55,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112369 s, 91.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:57,154::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:57,154::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:57,154::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:57,155::__init__::232::IOProcess::(_processLogs) (40798) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:57,155::__init__::232::IOProcess::(_processLogs) (40798) Queuing response >Thread-47::DEBUG::2014-09-16 10:43:57,155::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:43:57,160::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000323446 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:57,161::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:57,161::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:57,161::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:57,161::__init__::232::IOProcess::(_processLogs) (40799) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:57,162::__init__::232::IOProcess::(_processLogs) (40799) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:57,184::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:57,184::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:57,184::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:57,184::__init__::232::IOProcess::(_processLogs) (40800) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:57,184::__init__::232::IOProcess::(_processLogs) (40800) Queuing response >Thread-21::DEBUG::2014-09-16 10:43:57,185::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:43:57,190::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000330971 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:43:57,191::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:57,191::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:57,191::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:57,191::__init__::232::IOProcess::(_processLogs) (40801) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:43:57,191::__init__::232::IOProcess::(_processLogs) (40801) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:57,192::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:57,192::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:57,192::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:57,192::__init__::232::IOProcess::(_processLogs) (40802) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:57,192::__init__::232::IOProcess::(_processLogs) (40802) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:57,193::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:57,193::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:57,193::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:57,193::__init__::232::IOProcess::(_processLogs) (40803) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:57,193::__init__::232::IOProcess::(_processLogs) (40803) Queuing response >Thread-14::DEBUG::2014-09-16 10:43:57,193::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:43:57,194::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:43:57,194::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:43:57,194::__init__::232::IOProcess::(_processLogs) (40804) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:43:57,194::__init__::232::IOProcess::(_processLogs) (40804) Queuing response >Dummy-37::DEBUG::2014-09-16 10:43:57,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:57,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112959 s, 90.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:43:59,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:43:59,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113445 s, 90.3 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:44:00,781::task::595::Storage.TaskManager.Task::(_updateState) Task=`23241bdd-6c0f-4bff-a111-65c9e5a582d5`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:44:00,781::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:44:00,781::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000323446', 'lastCheck': '3.6', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330971', 'lastCheck': '3.6', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:44:00,781::task::1191::Storage.TaskManager.Task::(prepare) Task=`23241bdd-6c0f-4bff-a111-65c9e5a582d5`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000323446', 'lastCheck': '3.6', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330971', 'lastCheck': '3.6', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:44:00,781::task::595::Storage.TaskManager.Task::(_updateState) Task=`23241bdd-6c0f-4bff-a111-65c9e5a582d5`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:44:00,781::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:44:00,781::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:44:00,781::task::993::Storage.TaskManager.Task::(_decref) Task=`23241bdd-6c0f-4bff-a111-65c9e5a582d5`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:44:01,513::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:44:01,513::task::595::Storage.TaskManager.Task::(_updateState) Task=`f320acfc-4089-44ef-a283-9a97de5e1970`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:44:01,513::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:44:01,525::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:44:01,525::task::1191::Storage.TaskManager.Task::(prepare) Task=`f320acfc-4089-44ef-a283-9a97de5e1970`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:44:01,525::task::595::Storage.TaskManager.Task::(_updateState) Task=`f320acfc-4089-44ef-a283-9a97de5e1970`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:44:01,526::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:44:01,526::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:44:01,526::task::993::Storage.TaskManager.Task::(_decref) Task=`f320acfc-4089-44ef-a283-9a97de5e1970`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:44:01,564::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:44:01,565::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb7052b9-396a-4c31-aaa5-790ac14af52f`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:44:01,565::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:44:01,565::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`df8fa920-f6ea-4fd7-9939-768cd38c1b1c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:44:01,565::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:44:01,565::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:44:01,565::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`df8fa920-f6ea-4fd7-9939-768cd38c1b1c`::Granted request >Thread-38::DEBUG::2014-09-16 10:44:01,566::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`eb7052b9-396a-4c31-aaa5-790ac14af52f`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:44:01,566::task::993::Storage.TaskManager.Task::(_decref) Task=`eb7052b9-396a-4c31-aaa5-790ac14af52f`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:44:01,578::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:44:01,578::task::1191::Storage.TaskManager.Task::(prepare) Task=`eb7052b9-396a-4c31-aaa5-790ac14af52f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:44:01,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb7052b9-396a-4c31-aaa5-790ac14af52f`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:44:01,578::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:44:01,578::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:44:01,578::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:44:01,578::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:44:01,578::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:44:01,578::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:44:01,578::task::993::Storage.TaskManager.Task::(_decref) Task=`eb7052b9-396a-4c31-aaa5-790ac14af52f`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:44:01,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:01,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113638 s, 90.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:44:03,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:03,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011285 s, 90.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:44:05,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:05,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113865 s, 89.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:44:07,163::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:07,163::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:07,163::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:07,163::__init__::232::IOProcess::(_processLogs) (40805) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:07,163::__init__::232::IOProcess::(_processLogs) (40805) Queuing response >Thread-47::DEBUG::2014-09-16 10:44:07,164::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:44:07,170::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000300713 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:44:07,170::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:07,170::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:07,170::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:07,171::__init__::232::IOProcess::(_processLogs) (40806) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:07,171::__init__::232::IOProcess::(_processLogs) (40806) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:07,195::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:07,195::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:07,195::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:07,195::__init__::232::IOProcess::(_processLogs) (40807) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:07,195::__init__::232::IOProcess::(_processLogs) (40807) Queuing response >Thread-21::DEBUG::2014-09-16 10:44:07,196::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:44:07,201::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000354667 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:44:07,202::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:07,202::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:07,202::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:07,202::__init__::232::IOProcess::(_processLogs) (40808) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:07,202::__init__::232::IOProcess::(_processLogs) (40808) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:07,203::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:07,203::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:07,203::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:07,203::__init__::232::IOProcess::(_processLogs) (40809) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:07,203::__init__::232::IOProcess::(_processLogs) (40809) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:07,204::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:07,204::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:07,204::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:07,204::__init__::232::IOProcess::(_processLogs) (40810) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:07,204::__init__::232::IOProcess::(_processLogs) (40810) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:07,204::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:07,205::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:07,205::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:07,205::__init__::232::IOProcess::(_processLogs) (40811) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:07,205::__init__::232::IOProcess::(_processLogs) (40811) Queuing response >Dummy-37::DEBUG::2014-09-16 10:44:07,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:07,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113789 s, 90.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:44:09,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:09,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011379 s, 90.0 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:44:11,675::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:44:11,675::task::595::Storage.TaskManager.Task::(_updateState) Task=`daf55199-7270-46c8-bc6e-aebc31399c9a`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:44:11,675::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:44:11,687::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:44:11,687::task::1191::Storage.TaskManager.Task::(prepare) Task=`daf55199-7270-46c8-bc6e-aebc31399c9a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:44:11,687::task::595::Storage.TaskManager.Task::(_updateState) Task=`daf55199-7270-46c8-bc6e-aebc31399c9a`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:44:11,687::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:44:11,687::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:44:11,687::task::993::Storage.TaskManager.Task::(_decref) Task=`daf55199-7270-46c8-bc6e-aebc31399c9a`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:44:11,722::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:44:11,722::task::595::Storage.TaskManager.Task::(_updateState) Task=`882e78f9-2f23-45dc-ada7-42bdfb7cafc2`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:44:11,722::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:44:11,722::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`dbda329e-0eb0-4e19-88f7-938ee437001a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:44:11,722::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:44:11,722::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:44:11,723::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`dbda329e-0eb0-4e19-88f7-938ee437001a`::Granted request >Thread-38::DEBUG::2014-09-16 10:44:11,723::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`882e78f9-2f23-45dc-ada7-42bdfb7cafc2`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:44:11,723::task::993::Storage.TaskManager.Task::(_decref) Task=`882e78f9-2f23-45dc-ada7-42bdfb7cafc2`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:44:11,735::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:44:11,735::task::1191::Storage.TaskManager.Task::(prepare) Task=`882e78f9-2f23-45dc-ada7-42bdfb7cafc2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:44:11,735::task::595::Storage.TaskManager.Task::(_updateState) Task=`882e78f9-2f23-45dc-ada7-42bdfb7cafc2`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:44:11,735::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:44:11,735::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:44:11,735::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:44:11,735::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:44:11,735::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:44:11,736::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:44:11,736::task::993::Storage.TaskManager.Task::(_decref) Task=`882e78f9-2f23-45dc-ada7-42bdfb7cafc2`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:44:11,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:12,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113482 s, 90.2 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:44:14,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:14,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177114 s, 57.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:44:16,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:16,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113545 s, 90.2 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:44:16,658::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a7a0cf8-23cd-49d5-9ff3-730c38487a91`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:44:16,659::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:44:16,659::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300713', 'lastCheck': '9.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354667', 'lastCheck': '9.5', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:44:16,659::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a7a0cf8-23cd-49d5-9ff3-730c38487a91`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300713', 'lastCheck': '9.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354667', 'lastCheck': '9.5', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:44:16,659::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a7a0cf8-23cd-49d5-9ff3-730c38487a91`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:44:16,659::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:44:16,659::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:44:16,659::task::993::Storage.TaskManager.Task::(_decref) Task=`5a7a0cf8-23cd-49d5-9ff3-730c38487a91`::ref 0 aborting False >Thread-14::DEBUG::2014-09-16 10:44:17,172::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:17,172::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:17,173::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:17,173::__init__::232::IOProcess::(_processLogs) (40812) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:17,173::__init__::232::IOProcess::(_processLogs) (40812) Queuing response >Thread-47::DEBUG::2014-09-16 10:44:17,174::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:44:17,179::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000315306 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:44:17,180::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:17,180::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:17,180::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:17,180::__init__::232::IOProcess::(_processLogs) (40813) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:17,180::__init__::232::IOProcess::(_processLogs) (40813) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:17,206::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:17,206::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:17,206::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:17,206::__init__::232::IOProcess::(_processLogs) (40814) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:17,206::__init__::232::IOProcess::(_processLogs) (40814) Queuing response >Thread-21::DEBUG::2014-09-16 10:44:17,207::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:44:17,212::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000352666 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:44:17,212::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:17,213::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:17,213::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:17,213::__init__::232::IOProcess::(_processLogs) (40815) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:17,213::__init__::232::IOProcess::(_processLogs) (40815) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:17,214::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:17,214::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:17,214::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:17,214::__init__::232::IOProcess::(_processLogs) (40816) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:17,214::__init__::232::IOProcess::(_processLogs) (40816) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:17,215::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:17,215::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:17,215::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:17,215::__init__::232::IOProcess::(_processLogs) (40817) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:17,215::__init__::232::IOProcess::(_processLogs) (40817) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:17,215::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:17,215::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:17,216::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:17,216::__init__::232::IOProcess::(_processLogs) (40818) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:17,216::__init__::232::IOProcess::(_processLogs) (40818) Queuing response >Dummy-37::DEBUG::2014-09-16 10:44:18,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:19,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.33523 s, 767 kB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:44:21,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-97::DEBUG::2014-09-16 10:44:21,864::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:44:21,864::task::595::Storage.TaskManager.Task::(_updateState) Task=`13962eba-0ddd-4d83-9f51-70b10daed3e3`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:44:21,864::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:44:23,047::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Dummy-37::DEBUG::2014-09-16 10:44:23,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.46228 s, 700 kB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:44:23,047::task::1191::Storage.TaskManager.Task::(prepare) Task=`13962eba-0ddd-4d83-9f51-70b10daed3e3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:44:23,048::task::595::Storage.TaskManager.Task::(_updateState) Task=`13962eba-0ddd-4d83-9f51-70b10daed3e3`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:44:23,048::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:44:23,048::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:44:23,049::task::993::Storage.TaskManager.Task::(_decref) Task=`13962eba-0ddd-4d83-9f51-70b10daed3e3`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:44:23,080::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:44:23,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ab07847-c73e-4b96-abba-1b9883cfdaf8`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:44:23,080::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:44:23,080::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`1220412a-6063-422c-a29b-328bab4f7eaa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:44:23,080::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:44:23,081::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:44:23,081::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`1220412a-6063-422c-a29b-328bab4f7eaa`::Granted request >Thread-38::DEBUG::2014-09-16 10:44:23,081::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2ab07847-c73e-4b96-abba-1b9883cfdaf8`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:44:23,081::task::993::Storage.TaskManager.Task::(_decref) Task=`2ab07847-c73e-4b96-abba-1b9883cfdaf8`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:44:23,093::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:44:23,093::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ab07847-c73e-4b96-abba-1b9883cfdaf8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:44:23,093::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ab07847-c73e-4b96-abba-1b9883cfdaf8`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:44:23,093::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:44:23,093::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:44:23,093::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:44:23,094::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:44:23,094::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:44:23,094::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:44:23,094::task::993::Storage.TaskManager.Task::(_decref) Task=`2ab07847-c73e-4b96-abba-1b9883cfdaf8`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:44:25,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:25,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112758 s, 90.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:44:27,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:27,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114203 s, 89.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:44:27,182::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:27,182::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:27,182::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:27,182::__init__::232::IOProcess::(_processLogs) (40819) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:27,182::__init__::232::IOProcess::(_processLogs) (40819) Queuing response >Thread-47::DEBUG::2014-09-16 10:44:27,183::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:44:27,188::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000310923 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:44:27,189::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:27,189::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:27,189::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:27,189::__init__::232::IOProcess::(_processLogs) (40820) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:27,189::__init__::232::IOProcess::(_processLogs) (40820) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:27,217::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:27,217::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:27,217::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:27,217::__init__::232::IOProcess::(_processLogs) (40821) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:27,217::__init__::232::IOProcess::(_processLogs) (40821) Queuing response >Thread-21::DEBUG::2014-09-16 10:44:27,217::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:44:27,223::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000340676 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:44:27,223::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:27,224::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:27,224::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:27,224::__init__::232::IOProcess::(_processLogs) (40822) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:27,224::__init__::232::IOProcess::(_processLogs) (40822) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:27,225::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:27,225::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:27,225::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:27,225::__init__::232::IOProcess::(_processLogs) (40823) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:27,225::__init__::232::IOProcess::(_processLogs) (40823) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:27,225::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:27,226::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:27,226::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:27,226::__init__::232::IOProcess::(_processLogs) (40824) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:27,226::__init__::232::IOProcess::(_processLogs) (40824) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:27,226::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:27,226::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:27,226::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:27,227::__init__::232::IOProcess::(_processLogs) (40825) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:27,227::__init__::232::IOProcess::(_processLogs) (40825) Queuing response >Dummy-37::DEBUG::2014-09-16 10:44:29,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:29,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112863 s, 90.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:44:31,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:31,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113315 s, 90.4 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:44:32,656::task::595::Storage.TaskManager.Task::(_updateState) Task=`aecc7d28-6726-4197-baf6-379a6aac4af2`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:44:32,656::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:44:32,656::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000310923', 'lastCheck': '5.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340676', 'lastCheck': '5.4', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:44:32,656::task::1191::Storage.TaskManager.Task::(prepare) Task=`aecc7d28-6726-4197-baf6-379a6aac4af2`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000310923', 'lastCheck': '5.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340676', 'lastCheck': '5.4', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:44:32,656::task::595::Storage.TaskManager.Task::(_updateState) Task=`aecc7d28-6726-4197-baf6-379a6aac4af2`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:44:32,656::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:44:32,657::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:44:32,657::task::993::Storage.TaskManager.Task::(_decref) Task=`aecc7d28-6726-4197-baf6-379a6aac4af2`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:44:33,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:33,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112435 s, 91.1 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:44:33,444::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:44:33,444::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb857061-b522-49d8-8a10-0f7837072a18`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:44:33,444::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:44:33,455::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:44:33,456::task::1191::Storage.TaskManager.Task::(prepare) Task=`eb857061-b522-49d8-8a10-0f7837072a18`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:44:33,456::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb857061-b522-49d8-8a10-0f7837072a18`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:44:33,456::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:44:33,456::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:44:33,456::task::993::Storage.TaskManager.Task::(_decref) Task=`eb857061-b522-49d8-8a10-0f7837072a18`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:44:33,486::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:44:33,486::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b62e481-de11-4b3c-81e1-bce93a43f368`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:44:33,486::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:44:33,486::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`c0465381-39e4-44ae-b466-16cd62e8dcf1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:44:33,487::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:44:33,487::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:44:33,487::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`c0465381-39e4-44ae-b466-16cd62e8dcf1`::Granted request >Thread-38::DEBUG::2014-09-16 10:44:33,487::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2b62e481-de11-4b3c-81e1-bce93a43f368`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:44:33,487::task::993::Storage.TaskManager.Task::(_decref) Task=`2b62e481-de11-4b3c-81e1-bce93a43f368`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:44:33,499::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:44:33,499::task::1191::Storage.TaskManager.Task::(prepare) Task=`2b62e481-de11-4b3c-81e1-bce93a43f368`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:44:33,499::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b62e481-de11-4b3c-81e1-bce93a43f368`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:44:33,500::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:44:33,500::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:44:33,500::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:44:33,500::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:44:33,500::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:44:33,500::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:44:33,500::task::993::Storage.TaskManager.Task::(_decref) Task=`2b62e481-de11-4b3c-81e1-bce93a43f368`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:44:35,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:35,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0108677 s, 94.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:44:37,190::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:37,191::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:37,191::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:37,191::__init__::232::IOProcess::(_processLogs) (40826) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:37,191::__init__::232::IOProcess::(_processLogs) (40826) Queuing response >Thread-47::DEBUG::2014-09-16 10:44:37,191::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:44:37,197::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000306031 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:44:37,198::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:37,198::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:37,198::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:37,198::__init__::232::IOProcess::(_processLogs) (40827) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:37,198::__init__::232::IOProcess::(_processLogs) (40827) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:37,227::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:37,228::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:37,228::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:37,228::__init__::232::IOProcess::(_processLogs) (40828) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:37,228::__init__::232::IOProcess::(_processLogs) (40828) Queuing response >Thread-21::DEBUG::2014-09-16 10:44:37,229::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:44:37,234::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000350247 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:44:37,235::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:37,235::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:37,235::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:37,235::__init__::232::IOProcess::(_processLogs) (40829) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:37,235::__init__::232::IOProcess::(_processLogs) (40829) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:37,236::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:37,236::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:37,236::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:37,236::__init__::232::IOProcess::(_processLogs) (40830) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:37,236::__init__::232::IOProcess::(_processLogs) (40830) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:37,237::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:37,237::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:37,237::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:37,237::__init__::232::IOProcess::(_processLogs) (40831) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:37,237::__init__::232::IOProcess::(_processLogs) (40831) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:37,238::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:37,238::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:37,238::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:37,238::__init__::232::IOProcess::(_processLogs) (40832) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:37,238::__init__::232::IOProcess::(_processLogs) (40832) Queuing response >Dummy-37::DEBUG::2014-09-16 10:44:37,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:37,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115803 s, 88.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:44:39,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:39,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114256 s, 89.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:44:41,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:41,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112143 s, 91.3 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:44:43,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:43,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112018 s, 91.4 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:44:43,833::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:44:43,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`8039e573-d771-4a94-8fca-60fcf1367fc5`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:44:43,833::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:44:43,844::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:44:43,845::task::1191::Storage.TaskManager.Task::(prepare) Task=`8039e573-d771-4a94-8fca-60fcf1367fc5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:44:43,845::task::595::Storage.TaskManager.Task::(_updateState) Task=`8039e573-d771-4a94-8fca-60fcf1367fc5`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:44:43,845::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:44:43,845::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:44:43,845::task::993::Storage.TaskManager.Task::(_decref) Task=`8039e573-d771-4a94-8fca-60fcf1367fc5`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:44:43,875::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:44:43,875::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d8e9a2e-4676-40d9-8dff-1ce2e6c775c6`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:44:43,875::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:44:43,876::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`f5dbcf3d-60fb-4ea3-9327-83594456c7db`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:44:43,876::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:44:43,876::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:44:43,876::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`f5dbcf3d-60fb-4ea3-9327-83594456c7db`::Granted request >Thread-38::DEBUG::2014-09-16 10:44:43,876::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7d8e9a2e-4676-40d9-8dff-1ce2e6c775c6`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:44:43,876::task::993::Storage.TaskManager.Task::(_decref) Task=`7d8e9a2e-4676-40d9-8dff-1ce2e6c775c6`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:44:43,888::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:44:43,888::task::1191::Storage.TaskManager.Task::(prepare) Task=`7d8e9a2e-4676-40d9-8dff-1ce2e6c775c6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:44:43,888::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d8e9a2e-4676-40d9-8dff-1ce2e6c775c6`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:44:43,888::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:44:43,889::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:44:43,889::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:44:43,889::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:44:43,889::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:44:43,889::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:44:43,889::task::993::Storage.TaskManager.Task::(_decref) Task=`7d8e9a2e-4676-40d9-8dff-1ce2e6c775c6`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:44:45,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:45,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113962 s, 89.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:44:47,199::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:47,199::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:47,200::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:47,200::__init__::232::IOProcess::(_processLogs) (40833) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:47,200::__init__::232::IOProcess::(_processLogs) (40833) Queuing response >Thread-47::DEBUG::2014-09-16 10:44:47,200::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:44:47,206::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000294024 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:44:47,207::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:47,207::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:47,207::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:47,207::__init__::232::IOProcess::(_processLogs) (40834) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:47,207::__init__::232::IOProcess::(_processLogs) (40834) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:47,239::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:47,239::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:47,239::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:47,239::__init__::232::IOProcess::(_processLogs) (40835) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:47,239::__init__::232::IOProcess::(_processLogs) (40835) Queuing response >Thread-21::DEBUG::2014-09-16 10:44:47,240::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:44:47,245::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000317977 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:44:47,246::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:47,246::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:47,246::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:47,246::__init__::232::IOProcess::(_processLogs) (40836) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:47,246::__init__::232::IOProcess::(_processLogs) (40836) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:47,247::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:47,247::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:47,247::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:47,247::__init__::232::IOProcess::(_processLogs) (40837) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:47,247::__init__::232::IOProcess::(_processLogs) (40837) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:47,248::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:47,248::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:47,248::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:47,248::__init__::232::IOProcess::(_processLogs) (40838) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:47,248::__init__::232::IOProcess::(_processLogs) (40838) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:47,249::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:47,249::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:47,249::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:47,249::__init__::232::IOProcess::(_processLogs) (40839) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:47,249::__init__::232::IOProcess::(_processLogs) (40839) Queuing response >Dummy-37::DEBUG::2014-09-16 10:44:47,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:47,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113138 s, 90.5 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:44:48,925::task::595::Storage.TaskManager.Task::(_updateState) Task=`b66a5c84-6fc8-46ba-bedd-ec4371e425e7`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:44:48,925::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:44:48,925::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000294024', 'lastCheck': '1.7', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000317977', 'lastCheck': '1.7', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:44:48,925::task::1191::Storage.TaskManager.Task::(prepare) Task=`b66a5c84-6fc8-46ba-bedd-ec4371e425e7`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000294024', 'lastCheck': '1.7', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000317977', 'lastCheck': '1.7', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:44:48,925::task::595::Storage.TaskManager.Task::(_updateState) Task=`b66a5c84-6fc8-46ba-bedd-ec4371e425e7`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:44:48,925::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:44:48,925::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:44:48,926::task::993::Storage.TaskManager.Task::(_decref) Task=`b66a5c84-6fc8-46ba-bedd-ec4371e425e7`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:44:49,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:49,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113926 s, 89.9 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:44:51,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:51,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113221 s, 90.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:44:53,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:53,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112485 s, 91.0 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:44:54,050::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:44:54,051::task::595::Storage.TaskManager.Task::(_updateState) Task=`78fef3d4-f475-4f88-8e00-fef66c5769f8`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:44:54,051::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:44:54,062::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:44:54,062::task::1191::Storage.TaskManager.Task::(prepare) Task=`78fef3d4-f475-4f88-8e00-fef66c5769f8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:44:54,062::task::595::Storage.TaskManager.Task::(_updateState) Task=`78fef3d4-f475-4f88-8e00-fef66c5769f8`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:44:54,062::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:44:54,062::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:44:54,062::task::993::Storage.TaskManager.Task::(_decref) Task=`78fef3d4-f475-4f88-8e00-fef66c5769f8`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:44:54,095::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:44:54,095::task::595::Storage.TaskManager.Task::(_updateState) Task=`57732ace-8f13-48ec-84a2-80983394c983`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:44:54,095::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:44:54,095::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`4f1f550c-67db-41f5-9a16-cdabeedd6a3a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:44:54,095::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:44:54,095::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:44:54,096::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`4f1f550c-67db-41f5-9a16-cdabeedd6a3a`::Granted request >Thread-38::DEBUG::2014-09-16 10:44:54,096::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`57732ace-8f13-48ec-84a2-80983394c983`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:44:54,096::task::993::Storage.TaskManager.Task::(_decref) Task=`57732ace-8f13-48ec-84a2-80983394c983`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:44:54,108::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:44:54,108::task::1191::Storage.TaskManager.Task::(prepare) Task=`57732ace-8f13-48ec-84a2-80983394c983`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:44:54,108::task::595::Storage.TaskManager.Task::(_updateState) Task=`57732ace-8f13-48ec-84a2-80983394c983`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:44:54,108::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:44:54,108::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:44:54,108::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:44:54,109::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:44:54,109::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:44:54,109::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:44:54,109::task::993::Storage.TaskManager.Task::(_decref) Task=`57732ace-8f13-48ec-84a2-80983394c983`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:44:55,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:55,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011266 s, 90.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:44:57,208::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:57,209::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:57,209::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:57,209::__init__::232::IOProcess::(_processLogs) (40840) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:57,209::__init__::232::IOProcess::(_processLogs) (40840) Queuing response >Thread-47::DEBUG::2014-09-16 10:44:57,210::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:44:57,215::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000304418 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:44:57,216::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:57,216::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:57,216::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:57,216::__init__::232::IOProcess::(_processLogs) (40841) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:57,216::__init__::232::IOProcess::(_processLogs) (40841) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:57,250::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:57,250::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:57,250::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:57,250::__init__::232::IOProcess::(_processLogs) (40842) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:57,250::__init__::232::IOProcess::(_processLogs) (40842) Queuing response >Thread-21::DEBUG::2014-09-16 10:44:57,251::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:44:57,256::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000311981 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:44:57,257::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:57,257::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:57,257::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:57,257::__init__::232::IOProcess::(_processLogs) (40843) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:44:57,257::__init__::232::IOProcess::(_processLogs) (40843) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:57,258::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:57,258::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:57,258::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:57,258::__init__::232::IOProcess::(_processLogs) (40844) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:57,258::__init__::232::IOProcess::(_processLogs) (40844) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:57,259::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:57,259::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:57,259::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:57,259::__init__::232::IOProcess::(_processLogs) (40845) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:57,259::__init__::232::IOProcess::(_processLogs) (40845) Queuing response >Thread-14::DEBUG::2014-09-16 10:44:57,260::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:44:57,260::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:44:57,260::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:44:57,260::__init__::232::IOProcess::(_processLogs) (40846) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:44:57,260::__init__::232::IOProcess::(_processLogs) (40846) Queuing response >Dummy-37::DEBUG::2014-09-16 10:44:57,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:57,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116008 s, 88.3 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:44:59,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:44:59,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117071 s, 87.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:45:01,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:01,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112458 s, 91.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:45:03,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:04,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113323 s, 90.4 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:45:04,190::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:45:04,191::task::595::Storage.TaskManager.Task::(_updateState) Task=`aeaec671-44fb-439b-bbfc-c4e1a753cffc`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:45:04,191::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:45:04,203::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:45:04,203::task::1191::Storage.TaskManager.Task::(prepare) Task=`aeaec671-44fb-439b-bbfc-c4e1a753cffc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:45:04,203::task::595::Storage.TaskManager.Task::(_updateState) Task=`aeaec671-44fb-439b-bbfc-c4e1a753cffc`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:45:04,203::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:45:04,203::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:45:04,203::task::993::Storage.TaskManager.Task::(_decref) Task=`aeaec671-44fb-439b-bbfc-c4e1a753cffc`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:45:04,234::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:45:04,235::task::595::Storage.TaskManager.Task::(_updateState) Task=`7486d2bf-4fa8-4424-b6b9-0483eb679bc1`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:45:04,235::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:45:04,235::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`803a331a-be79-4231-a7c4-3944de6db4cf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:45:04,235::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:45:04,235::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:45:04,235::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`803a331a-be79-4231-a7c4-3944de6db4cf`::Granted request >Thread-38::DEBUG::2014-09-16 10:45:04,236::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7486d2bf-4fa8-4424-b6b9-0483eb679bc1`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:45:04,236::task::993::Storage.TaskManager.Task::(_decref) Task=`7486d2bf-4fa8-4424-b6b9-0483eb679bc1`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:45:04,248::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:45:04,248::task::1191::Storage.TaskManager.Task::(prepare) Task=`7486d2bf-4fa8-4424-b6b9-0483eb679bc1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:45:04,248::task::595::Storage.TaskManager.Task::(_updateState) Task=`7486d2bf-4fa8-4424-b6b9-0483eb679bc1`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:45:04,248::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:45:04,248::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:45:04,248::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:45:04,248::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:45:04,248::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:45:04,249::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:45:04,249::task::993::Storage.TaskManager.Task::(_decref) Task=`7486d2bf-4fa8-4424-b6b9-0483eb679bc1`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:45:04,768::task::595::Storage.TaskManager.Task::(_updateState) Task=`aaad2c6b-454c-4465-b936-46ec9c6ea2be`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:45:04,769::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:45:04,769::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000304418', 'lastCheck': '7.6', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311981', 'lastCheck': '7.5', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:45:04,769::task::1191::Storage.TaskManager.Task::(prepare) Task=`aaad2c6b-454c-4465-b936-46ec9c6ea2be`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000304418', 'lastCheck': '7.6', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311981', 'lastCheck': '7.5', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:45:04,769::task::595::Storage.TaskManager.Task::(_updateState) Task=`aaad2c6b-454c-4465-b936-46ec9c6ea2be`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:45:04,769::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:45:04,769::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:45:04,769::task::993::Storage.TaskManager.Task::(_decref) Task=`aaad2c6b-454c-4465-b936-46ec9c6ea2be`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:45:06,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:06,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114004 s, 89.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:45:07,218::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:07,218::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:07,218::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:07,218::__init__::232::IOProcess::(_processLogs) (40847) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:07,218::__init__::232::IOProcess::(_processLogs) (40847) Queuing response >Thread-47::DEBUG::2014-09-16 10:45:07,219::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:45:07,224::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000331566 s, 980 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:45:07,225::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:07,225::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:07,225::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:07,225::__init__::232::IOProcess::(_processLogs) (40848) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:07,225::__init__::232::IOProcess::(_processLogs) (40848) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:07,261::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:07,261::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:07,261::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:07,261::__init__::232::IOProcess::(_processLogs) (40849) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:07,261::__init__::232::IOProcess::(_processLogs) (40849) Queuing response >Thread-21::DEBUG::2014-09-16 10:45:07,262::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:45:07,267::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000389677 s, 1.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:45:07,268::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:07,268::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:07,268::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:07,268::__init__::232::IOProcess::(_processLogs) (40850) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:07,268::__init__::232::IOProcess::(_processLogs) (40850) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:07,269::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:07,269::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:07,269::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:07,269::__init__::232::IOProcess::(_processLogs) (40851) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:07,269::__init__::232::IOProcess::(_processLogs) (40851) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:07,270::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:07,270::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:07,270::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:07,270::__init__::232::IOProcess::(_processLogs) (40852) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:07,270::__init__::232::IOProcess::(_processLogs) (40852) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:07,271::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:07,271::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:07,271::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:07,271::__init__::232::IOProcess::(_processLogs) (40853) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:07,271::__init__::232::IOProcess::(_processLogs) (40853) Queuing response >Dummy-37::DEBUG::2014-09-16 10:45:08,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:08,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112479 s, 91.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:45:10,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:10,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112258 s, 91.2 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:45:12,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:12,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112898 s, 90.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:45:14,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:14,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0203567 s, 50.3 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:45:14,393::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:45:14,395::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e0f886f-aa40-44c3-848b-740b2967244b`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:45:14,396::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:45:14,408::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:45:14,409::task::1191::Storage.TaskManager.Task::(prepare) Task=`4e0f886f-aa40-44c3-848b-740b2967244b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:45:14,409::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e0f886f-aa40-44c3-848b-740b2967244b`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:45:14,410::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:45:14,410::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:45:14,411::task::993::Storage.TaskManager.Task::(_decref) Task=`4e0f886f-aa40-44c3-848b-740b2967244b`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:45:14,443::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:45:14,444::task::595::Storage.TaskManager.Task::(_updateState) Task=`218e8176-fc2b-4052-b09f-fd7e1eb9fac4`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:45:14,444::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:45:14,445::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`988e2ad5-19a1-4273-9f83-bcb5ba907919`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:45:14,446::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:45:14,447::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:45:14,447::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`988e2ad5-19a1-4273-9f83-bcb5ba907919`::Granted request >Thread-38::DEBUG::2014-09-16 10:45:14,448::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`218e8176-fc2b-4052-b09f-fd7e1eb9fac4`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:45:14,449::task::993::Storage.TaskManager.Task::(_decref) Task=`218e8176-fc2b-4052-b09f-fd7e1eb9fac4`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:45:14,466::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:45:14,466::task::1191::Storage.TaskManager.Task::(prepare) Task=`218e8176-fc2b-4052-b09f-fd7e1eb9fac4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:45:14,466::task::595::Storage.TaskManager.Task::(_updateState) Task=`218e8176-fc2b-4052-b09f-fd7e1eb9fac4`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:45:14,467::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:45:14,467::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:45:14,468::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:45:14,469::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:45:14,469::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:45:14,469::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:45:14,470::task::993::Storage.TaskManager.Task::(_decref) Task=`218e8176-fc2b-4052-b09f-fd7e1eb9fac4`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:45:16,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:16,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0110672 s, 92.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:45:17,227::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:17,227::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:17,227::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:17,227::__init__::232::IOProcess::(_processLogs) (40854) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:17,227::__init__::232::IOProcess::(_processLogs) (40854) Queuing response >Thread-47::DEBUG::2014-09-16 10:45:17,228::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:45:17,233::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000314992 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:45:17,234::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:17,234::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:17,234::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:17,234::__init__::232::IOProcess::(_processLogs) (40855) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:17,234::__init__::232::IOProcess::(_processLogs) (40855) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:17,272::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:17,272::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:17,272::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:17,272::__init__::232::IOProcess::(_processLogs) (40856) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:17,272::__init__::232::IOProcess::(_processLogs) (40856) Queuing response >Thread-21::DEBUG::2014-09-16 10:45:17,273::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:45:17,278::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000308661 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:45:17,278::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:17,279::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:17,279::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:17,279::__init__::232::IOProcess::(_processLogs) (40857) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:17,279::__init__::232::IOProcess::(_processLogs) (40857) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:17,280::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:17,280::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:17,280::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:17,280::__init__::232::IOProcess::(_processLogs) (40858) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:17,280::__init__::232::IOProcess::(_processLogs) (40858) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:17,280::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:17,280::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:17,281::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:17,281::__init__::232::IOProcess::(_processLogs) (40859) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:17,281::__init__::232::IOProcess::(_processLogs) (40859) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:17,281::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:17,281::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:17,281::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:17,281::__init__::232::IOProcess::(_processLogs) (40860) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:17,282::__init__::232::IOProcess::(_processLogs) (40860) Queuing response >Dummy-37::DEBUG::2014-09-16 10:45:18,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:18,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011293 s, 90.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:45:20,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:20,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112601 s, 90.9 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:45:20,751::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5ed75b4-97f9-46c7-8118-81c3ae1096c2`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:45:20,751::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:45:20,751::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000314992', 'lastCheck': '3.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308661', 'lastCheck': '3.5', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:45:20,751::task::1191::Storage.TaskManager.Task::(prepare) Task=`c5ed75b4-97f9-46c7-8118-81c3ae1096c2`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000314992', 'lastCheck': '3.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308661', 'lastCheck': '3.5', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:45:20,751::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5ed75b4-97f9-46c7-8118-81c3ae1096c2`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:45:20,751::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:45:20,751::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:45:20,752::task::993::Storage.TaskManager.Task::(_decref) Task=`c5ed75b4-97f9-46c7-8118-81c3ae1096c2`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:45:22,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:22,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011316 s, 90.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:45:24,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:24,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011299 s, 90.6 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:45:24,723::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:45:24,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c5c0886-e23f-4b0e-ad8c-95ec0a803cf6`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:45:24,723::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:45:24,734::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:45:24,735::task::1191::Storage.TaskManager.Task::(prepare) Task=`5c5c0886-e23f-4b0e-ad8c-95ec0a803cf6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:45:24,735::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c5c0886-e23f-4b0e-ad8c-95ec0a803cf6`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:45:24,735::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:45:24,735::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:45:24,735::task::993::Storage.TaskManager.Task::(_decref) Task=`5c5c0886-e23f-4b0e-ad8c-95ec0a803cf6`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:45:24,768::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:45:24,768::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c37b257-b0c3-4d3a-91e0-2b2d120c5dd9`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:45:24,768::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:45:24,769::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`da303e9b-fd8a-4d70-a564-74e1ec70c906`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:45:24,769::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:45:24,769::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:45:24,769::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`da303e9b-fd8a-4d70-a564-74e1ec70c906`::Granted request >Thread-38::DEBUG::2014-09-16 10:45:24,769::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7c37b257-b0c3-4d3a-91e0-2b2d120c5dd9`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:45:24,769::task::993::Storage.TaskManager.Task::(_decref) Task=`7c37b257-b0c3-4d3a-91e0-2b2d120c5dd9`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:45:24,781::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:45:24,781::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c37b257-b0c3-4d3a-91e0-2b2d120c5dd9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:45:24,782::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c37b257-b0c3-4d3a-91e0-2b2d120c5dd9`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:45:24,782::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:45:24,782::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:45:24,782::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:45:24,782::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:45:24,782::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:45:24,782::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:45:24,782::task::993::Storage.TaskManager.Task::(_decref) Task=`7c37b257-b0c3-4d3a-91e0-2b2d120c5dd9`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:45:26,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:26,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112941 s, 90.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:45:27,235::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:27,235::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:27,236::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:27,236::__init__::232::IOProcess::(_processLogs) (40861) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:27,236::__init__::232::IOProcess::(_processLogs) (40861) Queuing response >Thread-47::DEBUG::2014-09-16 10:45:27,236::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:45:27,242::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000323603 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:45:27,243::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:27,243::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:27,243::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:27,243::__init__::232::IOProcess::(_processLogs) (40862) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:27,243::__init__::232::IOProcess::(_processLogs) (40862) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:27,282::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:27,282::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:27,283::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:27,283::__init__::232::IOProcess::(_processLogs) (40863) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:27,283::__init__::232::IOProcess::(_processLogs) (40863) Queuing response >Thread-21::DEBUG::2014-09-16 10:45:27,283::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:45:27,288::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.00027695 s, 1.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:45:27,289::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:27,289::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:27,289::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:27,289::__init__::232::IOProcess::(_processLogs) (40864) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:27,289::__init__::232::IOProcess::(_processLogs) (40864) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:27,290::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:27,290::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:27,290::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:27,291::__init__::232::IOProcess::(_processLogs) (40865) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:27,291::__init__::232::IOProcess::(_processLogs) (40865) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:27,291::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:27,291::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:27,291::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:27,291::__init__::232::IOProcess::(_processLogs) (40866) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:27,291::__init__::232::IOProcess::(_processLogs) (40866) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:27,292::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:27,292::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:27,292::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:27,292::__init__::232::IOProcess::(_processLogs) (40867) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:27,292::__init__::232::IOProcess::(_processLogs) (40867) Queuing response >Dummy-37::DEBUG::2014-09-16 10:45:28,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:28,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113732 s, 90.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:45:30,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:30,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012988 s, 78.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:45:32,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:32,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127012 s, 80.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:45:34,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:34,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112917 s, 90.7 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:45:35,025::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:45:35,025::task::595::Storage.TaskManager.Task::(_updateState) Task=`77d419ad-cc18-459d-99aa-128127e52b8b`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:45:35,025::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:45:35,036::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:45:35,036::task::1191::Storage.TaskManager.Task::(prepare) Task=`77d419ad-cc18-459d-99aa-128127e52b8b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:45:35,037::task::595::Storage.TaskManager.Task::(_updateState) Task=`77d419ad-cc18-459d-99aa-128127e52b8b`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:45:35,037::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:45:35,037::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:45:35,037::task::993::Storage.TaskManager.Task::(_decref) Task=`77d419ad-cc18-459d-99aa-128127e52b8b`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:45:35,066::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:45:35,067::task::595::Storage.TaskManager.Task::(_updateState) Task=`9aa21792-74ae-41c1-b2a3-27896b9f808e`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:45:35,067::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:45:35,067::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`f69344a3-e6dd-4fbf-a394-8132efddbf5a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:45:35,067::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:45:35,067::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:45:35,067::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`f69344a3-e6dd-4fbf-a394-8132efddbf5a`::Granted request >Thread-38::DEBUG::2014-09-16 10:45:35,068::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9aa21792-74ae-41c1-b2a3-27896b9f808e`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:45:35,068::task::993::Storage.TaskManager.Task::(_decref) Task=`9aa21792-74ae-41c1-b2a3-27896b9f808e`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:45:35,080::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:45:35,080::task::1191::Storage.TaskManager.Task::(prepare) Task=`9aa21792-74ae-41c1-b2a3-27896b9f808e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:45:35,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`9aa21792-74ae-41c1-b2a3-27896b9f808e`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:45:35,080::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:45:35,080::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:45:35,080::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:45:35,080::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:45:35,080::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:45:35,080::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:45:35,081::task::993::Storage.TaskManager.Task::(_decref) Task=`9aa21792-74ae-41c1-b2a3-27896b9f808e`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:45:36,721::task::595::Storage.TaskManager.Task::(_updateState) Task=`81ef8b82-5d6c-499e-87df-981ac10df06e`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:45:36,721::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:45:36,722::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000323603', 'lastCheck': '9.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00027695', 'lastCheck': '9.4', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:45:36,722::task::1191::Storage.TaskManager.Task::(prepare) Task=`81ef8b82-5d6c-499e-87df-981ac10df06e`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000323603', 'lastCheck': '9.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00027695', 'lastCheck': '9.4', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:45:36,722::task::595::Storage.TaskManager.Task::(_updateState) Task=`81ef8b82-5d6c-499e-87df-981ac10df06e`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:45:36,722::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:45:36,722::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:45:36,722::task::993::Storage.TaskManager.Task::(_decref) Task=`81ef8b82-5d6c-499e-87df-981ac10df06e`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:45:36,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:36,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121352 s, 84.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:45:37,244::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:37,244::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:37,244::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:37,244::__init__::232::IOProcess::(_processLogs) (40868) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:37,245::__init__::232::IOProcess::(_processLogs) (40868) Queuing response >Thread-47::DEBUG::2014-09-16 10:45:37,245::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:45:37,250::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000296215 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:45:37,251::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:37,251::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:37,251::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:37,251::__init__::232::IOProcess::(_processLogs) (40869) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:37,252::__init__::232::IOProcess::(_processLogs) (40869) Queuing response >Thread-21::DEBUG::2014-09-16 10:45:37,293::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain b66bf4f1-94ad-487c-aa76-34598a679d7b >Thread-14::DEBUG::2014-09-16 10:45:37,294::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:37,295::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:37,295::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:37,295::__init__::232::IOProcess::(_processLogs) (40870) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:45:37,295::__init__::232::IOProcess::(_processLogs) (40870) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:37,295::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:37,296::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:37,297::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:37,297::__init__::232::IOProcess::(_processLogs) (40871) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:45:37,298::__init__::232::IOProcess::(_processLogs) (40871) Queuing response >Thread-21::DEBUG::2014-09-16 10:45:37,300::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b >Thread-14::DEBUG::2014-09-16 10:45:37,300::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:37,300::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:37,300::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:37,301::__init__::232::IOProcess::(_processLogs) (40872) Got request for method 'touch' >Thread-14::DEBUG::2014-09-16 10:45:37,301::__init__::232::IOProcess::(_processLogs) (40872) Queuing response >Thread-21::DEBUG::2014-09-16 10:45:37,302::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14::DEBUG::2014-09-16 10:45:37,302::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:37,302::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:37,302::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:37,302::__init__::232::IOProcess::(_processLogs) (40873) Got request for method 'readfile' >Thread-14::DEBUG::2014-09-16 10:45:37,303::__init__::232::IOProcess::(_processLogs) (40873) Queuing response >Thread-21::DEBUG::2014-09-16 10:45:37,303::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfs_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Global_DC_1', 'POOL_DOMAINS=b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=da06caa7-b08d-4685-b49c-84565c268648', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Master', 'SDUUID=b66bf4f1-94ad-487c-aa76-34598a679d7b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=895c938b406aa5adedd20a81fb4f17d5cf909767'] >Thread-14::DEBUG::2014-09-16 10:45:37,303::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:37,303::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:37,303::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:37,304::__init__::232::IOProcess::(_processLogs) (40874) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:37,304::__init__::232::IOProcess::(_processLogs) (40874) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:37,304::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:37,304::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:37,304::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:37,304::__init__::232::IOProcess::(_processLogs) (40875) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:45:37,304::__init__::232::IOProcess::(_processLogs) (40875) Queuing response >Thread-21::DEBUG::2014-09-16 10:45:37,305::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-21::INFO::2014-09-16 10:45:37,305::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b66bf4f1-94ad-487c-aa76-34598a679d7b_imageNS already registered >Thread-21::INFO::2014-09-16 10:45:37,305::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b66bf4f1-94ad-487c-aa76-34598a679d7b_volumeNS already registered >Thread-14::DEBUG::2014-09-16 10:45:37,305::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:37,305::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:37,305::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:37,305::__init__::232::IOProcess::(_processLogs) (40876) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:37,306::__init__::232::IOProcess::(_processLogs) (40876) Queuing response >Thread-21::DEBUG::2014-09-16 10:45:37,306::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:45:37,311::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000292566 s, 1.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:45:37,312::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:37,312::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:37,312::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:37,312::__init__::232::IOProcess::(_processLogs) (40877) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:37,312::__init__::232::IOProcess::(_processLogs) (40877) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:37,313::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:37,313::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:37,313::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:37,313::__init__::232::IOProcess::(_processLogs) (40878) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:37,313::__init__::232::IOProcess::(_processLogs) (40878) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:37,314::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:37,314::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:37,314::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:37,314::__init__::232::IOProcess::(_processLogs) (40879) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:37,314::__init__::232::IOProcess::(_processLogs) (40879) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:37,315::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:37,315::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:37,315::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:37,315::__init__::232::IOProcess::(_processLogs) (40880) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:37,315::__init__::232::IOProcess::(_processLogs) (40880) Queuing response >Dummy-37::DEBUG::2014-09-16 10:45:38,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:38,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113237 s, 90.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:45:40,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:40,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011133 s, 92.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:45:42,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:43,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112949 s, 90.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:45:45,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:45,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112545 s, 91.0 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:45:45,717::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:45:45,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`41adce68-34d0-4c01-a1dc-b38e5af6dc02`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:45:45,718::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:45:45,729::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:45:45,729::task::1191::Storage.TaskManager.Task::(prepare) Task=`41adce68-34d0-4c01-a1dc-b38e5af6dc02`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:45:45,729::task::595::Storage.TaskManager.Task::(_updateState) Task=`41adce68-34d0-4c01-a1dc-b38e5af6dc02`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:45:45,729::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:45:45,729::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:45:45,729::task::993::Storage.TaskManager.Task::(_decref) Task=`41adce68-34d0-4c01-a1dc-b38e5af6dc02`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:45:45,764::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:45:45,764::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ece5c67-2f75-4289-a75c-a4c0ac1592f2`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:45:45,764::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:45:45,765::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`3d82506a-4060-4a25-bb46-2b6ae2aa2cd7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:45:45,765::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:45:45,765::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:45:45,766::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`3d82506a-4060-4a25-bb46-2b6ae2aa2cd7`::Granted request >Thread-38::DEBUG::2014-09-16 10:45:45,766::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7ece5c67-2f75-4289-a75c-a4c0ac1592f2`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:45:45,766::task::993::Storage.TaskManager.Task::(_decref) Task=`7ece5c67-2f75-4289-a75c-a4c0ac1592f2`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:45:45,778::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:45:45,778::task::1191::Storage.TaskManager.Task::(prepare) Task=`7ece5c67-2f75-4289-a75c-a4c0ac1592f2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:45:45,778::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ece5c67-2f75-4289-a75c-a4c0ac1592f2`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:45:45,778::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:45:45,778::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:45:45,778::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:45:45,779::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:45:45,779::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:45:45,779::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:45:45,779::task::993::Storage.TaskManager.Task::(_decref) Task=`7ece5c67-2f75-4289-a75c-a4c0ac1592f2`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:45:47,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:47,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112195 s, 91.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:45:47,253::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:47,253::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:47,253::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:47,253::__init__::232::IOProcess::(_processLogs) (40881) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:47,253::__init__::232::IOProcess::(_processLogs) (40881) Queuing response >Thread-47::DEBUG::2014-09-16 10:45:47,254::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:45:47,260::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000322745 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:45:47,261::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:47,261::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:47,261::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:47,261::__init__::232::IOProcess::(_processLogs) (40882) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:47,261::__init__::232::IOProcess::(_processLogs) (40882) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:47,316::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:47,316::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:47,316::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:47,316::__init__::232::IOProcess::(_processLogs) (40883) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:47,316::__init__::232::IOProcess::(_processLogs) (40883) Queuing response >Thread-21::DEBUG::2014-09-16 10:45:47,317::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:45:47,323::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000334872 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:45:47,324::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:47,324::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:47,324::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:47,324::__init__::232::IOProcess::(_processLogs) (40884) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:47,324::__init__::232::IOProcess::(_processLogs) (40884) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:47,325::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:47,325::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:47,325::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:47,325::__init__::232::IOProcess::(_processLogs) (40885) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:47,325::__init__::232::IOProcess::(_processLogs) (40885) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:47,326::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:47,326::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:47,326::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:47,326::__init__::232::IOProcess::(_processLogs) (40886) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:47,326::__init__::232::IOProcess::(_processLogs) (40886) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:47,326::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:47,327::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:47,327::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:47,327::__init__::232::IOProcess::(_processLogs) (40887) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:47,327::__init__::232::IOProcess::(_processLogs) (40887) Queuing response >Dummy-37::DEBUG::2014-09-16 10:45:49,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:49,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123904 s, 82.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:45:51,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:51,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113745 s, 90.0 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:45:52,189::task::595::Storage.TaskManager.Task::(_updateState) Task=`56b509c2-c3c6-4971-8dca-2693d682a9f1`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:45:52,190::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:45:52,190::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000322745', 'lastCheck': '4.9', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334872', 'lastCheck': '4.9', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:45:52,190::task::1191::Storage.TaskManager.Task::(prepare) Task=`56b509c2-c3c6-4971-8dca-2693d682a9f1`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000322745', 'lastCheck': '4.9', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334872', 'lastCheck': '4.9', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:45:52,190::task::595::Storage.TaskManager.Task::(_updateState) Task=`56b509c2-c3c6-4971-8dca-2693d682a9f1`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:45:52,190::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:45:52,190::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:45:52,190::task::993::Storage.TaskManager.Task::(_decref) Task=`56b509c2-c3c6-4971-8dca-2693d682a9f1`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:45:53,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:53,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0111815 s, 91.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:45:55,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:55,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112815 s, 90.8 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:45:56,129::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:45:56,129::task::595::Storage.TaskManager.Task::(_updateState) Task=`a639cbb4-404d-4bcb-9055-f284a5a18b10`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:45:56,129::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:45:56,141::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:45:56,141::task::1191::Storage.TaskManager.Task::(prepare) Task=`a639cbb4-404d-4bcb-9055-f284a5a18b10`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:45:56,141::task::595::Storage.TaskManager.Task::(_updateState) Task=`a639cbb4-404d-4bcb-9055-f284a5a18b10`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:45:56,141::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:45:56,141::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:45:56,141::task::993::Storage.TaskManager.Task::(_decref) Task=`a639cbb4-404d-4bcb-9055-f284a5a18b10`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:45:56,172::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:45:56,173::task::595::Storage.TaskManager.Task::(_updateState) Task=`55a87128-405b-4b68-9999-a0e497564a4a`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:45:56,173::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:45:56,173::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`fe927bc9-8e8d-4aff-a958-638322708cf6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:45:56,173::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:45:56,173::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:45:56,173::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`fe927bc9-8e8d-4aff-a958-638322708cf6`::Granted request >Thread-38::DEBUG::2014-09-16 10:45:56,174::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`55a87128-405b-4b68-9999-a0e497564a4a`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:45:56,174::task::993::Storage.TaskManager.Task::(_decref) Task=`55a87128-405b-4b68-9999-a0e497564a4a`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:45:56,238::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:45:56,238::task::1191::Storage.TaskManager.Task::(prepare) Task=`55a87128-405b-4b68-9999-a0e497564a4a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:45:56,239::task::595::Storage.TaskManager.Task::(_updateState) Task=`55a87128-405b-4b68-9999-a0e497564a4a`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:45:56,239::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:45:56,239::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:45:56,239::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:45:56,239::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:45:56,239::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:45:56,239::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:45:56,239::task::993::Storage.TaskManager.Task::(_decref) Task=`55a87128-405b-4b68-9999-a0e497564a4a`::ref 0 aborting False >Thread-14::DEBUG::2014-09-16 10:45:57,262::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:57,262::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:57,263::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:57,263::__init__::232::IOProcess::(_processLogs) (40888) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:57,263::__init__::232::IOProcess::(_processLogs) (40888) Queuing response >Thread-47::DEBUG::2014-09-16 10:45:57,263::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:45:57,269::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.0003172 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:45:57,269::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:57,270::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:57,270::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:57,270::__init__::232::IOProcess::(_processLogs) (40889) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:57,270::__init__::232::IOProcess::(_processLogs) (40889) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:57,328::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:57,328::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:57,328::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:57,328::__init__::232::IOProcess::(_processLogs) (40890) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:57,328::__init__::232::IOProcess::(_processLogs) (40890) Queuing response >Thread-21::DEBUG::2014-09-16 10:45:57,328::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:45:57,334::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000315878 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:45:57,334::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:57,335::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:57,335::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:57,335::__init__::232::IOProcess::(_processLogs) (40891) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:45:57,335::__init__::232::IOProcess::(_processLogs) (40891) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:57,336::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:57,336::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:57,336::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:57,336::__init__::232::IOProcess::(_processLogs) (40892) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:57,336::__init__::232::IOProcess::(_processLogs) (40892) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:57,336::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:57,336::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:57,337::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:57,337::__init__::232::IOProcess::(_processLogs) (40893) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:57,337::__init__::232::IOProcess::(_processLogs) (40893) Queuing response >Thread-14::DEBUG::2014-09-16 10:45:57,337::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:45:57,337::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:45:57,337::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:45:57,337::__init__::232::IOProcess::(_processLogs) (40894) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:45:57,338::__init__::232::IOProcess::(_processLogs) (40894) Queuing response >Dummy-37::DEBUG::2014-09-16 10:45:57,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:57,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112766 s, 90.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:45:59,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:45:59,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112203 s, 91.3 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:01,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:01,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112024 s, 91.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:03,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:03,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113152 s, 90.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:05,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:05,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112929 s, 90.7 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:46:06,654::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:46:06,654::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f576744-1180-4e43-948a-ac396397e1ef`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:46:06,654::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:46:06,666::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:46:06,666::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f576744-1180-4e43-948a-ac396397e1ef`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:46:06,666::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f576744-1180-4e43-948a-ac396397e1ef`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:46:06,667::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:46:06,667::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:46:06,667::task::993::Storage.TaskManager.Task::(_decref) Task=`8f576744-1180-4e43-948a-ac396397e1ef`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:46:06,696::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:46:06,697::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd19cd44-6156-4669-b56b-fde5496d8ea5`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:46:06,697::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:46:06,697::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`5fff4bc2-ffbc-40b6-b5a7-7ae34642be61`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:46:06,697::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:46:06,697::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:46:06,697::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`5fff4bc2-ffbc-40b6-b5a7-7ae34642be61`::Granted request >Thread-38::DEBUG::2014-09-16 10:46:06,698::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cd19cd44-6156-4669-b56b-fde5496d8ea5`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:46:06,698::task::993::Storage.TaskManager.Task::(_decref) Task=`cd19cd44-6156-4669-b56b-fde5496d8ea5`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:46:06,710::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:46:06,710::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd19cd44-6156-4669-b56b-fde5496d8ea5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:46:06,710::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd19cd44-6156-4669-b56b-fde5496d8ea5`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:46:06,710::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:46:06,710::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:46:06,710::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:46:06,710::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:46:06,710::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:46:06,710::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:46:06,710::task::993::Storage.TaskManager.Task::(_decref) Task=`cd19cd44-6156-4669-b56b-fde5496d8ea5`::ref 0 aborting False >Thread-14::DEBUG::2014-09-16 10:46:07,271::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:07,271::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:07,271::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:07,271::__init__::232::IOProcess::(_processLogs) (40895) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:07,271::__init__::232::IOProcess::(_processLogs) (40895) Queuing response >Thread-47::DEBUG::2014-09-16 10:46:07,272::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:46:07,278::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000334918 s, 970 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:46:07,278::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:07,278::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:07,278::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:07,279::__init__::232::IOProcess::(_processLogs) (40896) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:07,279::__init__::232::IOProcess::(_processLogs) (40896) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:07,338::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:07,339::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:07,339::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:07,339::__init__::232::IOProcess::(_processLogs) (40897) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:07,339::__init__::232::IOProcess::(_processLogs) (40897) Queuing response >Thread-21::DEBUG::2014-09-16 10:46:07,339::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:46:07,345::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000319184 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:46:07,345::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:07,345::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:07,346::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:07,346::__init__::232::IOProcess::(_processLogs) (40898) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:07,346::__init__::232::IOProcess::(_processLogs) (40898) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:07,346::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:07,347::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:07,347::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:07,347::__init__::232::IOProcess::(_processLogs) (40899) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:07,347::__init__::232::IOProcess::(_processLogs) (40899) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:07,347::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:07,347::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:07,348::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:07,348::__init__::232::IOProcess::(_processLogs) (40900) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:07,348::__init__::232::IOProcess::(_processLogs) (40900) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:07,348::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:07,348::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:07,348::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:07,348::__init__::232::IOProcess::(_processLogs) (40901) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:07,348::__init__::232::IOProcess::(_processLogs) (40901) Queuing response >Dummy-37::DEBUG::2014-09-16 10:46:07,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:07,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112481 s, 91.0 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:46:07,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`17760599-ac01-40d4-ade8-883551cbdb2b`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:46:07,899::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:46:07,899::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000334918', 'lastCheck': '0.6', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319184', 'lastCheck': '0.5', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:46:07,899::task::1191::Storage.TaskManager.Task::(prepare) Task=`17760599-ac01-40d4-ade8-883551cbdb2b`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000334918', 'lastCheck': '0.6', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319184', 'lastCheck': '0.5', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:46:07,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`17760599-ac01-40d4-ade8-883551cbdb2b`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:46:07,899::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:46:07,899::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:46:07,899::task::993::Storage.TaskManager.Task::(_decref) Task=`17760599-ac01-40d4-ade8-883551cbdb2b`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:46:09,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:09,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112749 s, 90.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:11,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:11,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112285 s, 91.2 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:13,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:13,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113497 s, 90.2 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:15,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:15,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112386 s, 91.1 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:46:16,962::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:46:16,962::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f1201b2-6b75-4c71-a61d-a3bf76c7458b`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:46:16,963::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:46:16,975::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:46:16,975::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f1201b2-6b75-4c71-a61d-a3bf76c7458b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:46:16,975::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f1201b2-6b75-4c71-a61d-a3bf76c7458b`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:46:16,975::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:46:16,975::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:46:16,975::task::993::Storage.TaskManager.Task::(_decref) Task=`4f1201b2-6b75-4c71-a61d-a3bf76c7458b`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:46:17,005::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:46:17,005::task::595::Storage.TaskManager.Task::(_updateState) Task=`04ab8678-3da0-45cd-9b25-9c99b26c1830`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:46:17,005::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:46:17,006::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`2f170218-39bc-46b6-a7fa-62989f98b1de`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:46:17,006::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:46:17,006::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:46:17,006::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`2f170218-39bc-46b6-a7fa-62989f98b1de`::Granted request >Thread-38::DEBUG::2014-09-16 10:46:17,006::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`04ab8678-3da0-45cd-9b25-9c99b26c1830`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:46:17,006::task::993::Storage.TaskManager.Task::(_decref) Task=`04ab8678-3da0-45cd-9b25-9c99b26c1830`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:46:17,018::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:46:17,018::task::1191::Storage.TaskManager.Task::(prepare) Task=`04ab8678-3da0-45cd-9b25-9c99b26c1830`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:46:17,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`04ab8678-3da0-45cd-9b25-9c99b26c1830`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:46:17,019::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:46:17,019::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:46:17,019::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:46:17,019::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:46:17,019::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:46:17,019::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:46:17,019::task::993::Storage.TaskManager.Task::(_decref) Task=`04ab8678-3da0-45cd-9b25-9c99b26c1830`::ref 0 aborting False >Thread-14::DEBUG::2014-09-16 10:46:17,280::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:17,280::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:17,280::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:17,280::__init__::232::IOProcess::(_processLogs) (40902) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:17,280::__init__::232::IOProcess::(_processLogs) (40902) Queuing response >Thread-47::DEBUG::2014-09-16 10:46:17,281::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:46:17,286::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000307238 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:46:17,287::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:17,287::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:17,287::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:17,287::__init__::232::IOProcess::(_processLogs) (40903) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:17,287::__init__::232::IOProcess::(_processLogs) (40903) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:17,349::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:17,349::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:17,350::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:17,350::__init__::232::IOProcess::(_processLogs) (40904) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:17,350::__init__::232::IOProcess::(_processLogs) (40904) Queuing response >Thread-21::DEBUG::2014-09-16 10:46:17,350::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:46:17,355::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000310993 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:46:17,356::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:17,356::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:17,356::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:17,356::__init__::232::IOProcess::(_processLogs) (40905) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:17,357::__init__::232::IOProcess::(_processLogs) (40905) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:17,357::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:17,357::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:17,358::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:17,358::__init__::232::IOProcess::(_processLogs) (40906) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:17,358::__init__::232::IOProcess::(_processLogs) (40906) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:17,358::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:17,358::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:17,358::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:17,358::__init__::232::IOProcess::(_processLogs) (40907) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:17,359::__init__::232::IOProcess::(_processLogs) (40907) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:17,359::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:17,359::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:17,359::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:17,359::__init__::232::IOProcess::(_processLogs) (40908) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:17,359::__init__::232::IOProcess::(_processLogs) (40908) Queuing response >Dummy-37::DEBUG::2014-09-16 10:46:17,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:17,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112734 s, 90.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:19,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:19,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112391 s, 91.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:21,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:21,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113414 s, 90.3 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:46:23,450::task::595::Storage.TaskManager.Task::(_updateState) Task=`70b4ca2d-37b2-4ec8-95d0-0d9a883c875e`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:46:23,450::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:46:23,450::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000307238', 'lastCheck': '6.2', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000310993', 'lastCheck': '6.1', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:46:23,450::task::1191::Storage.TaskManager.Task::(prepare) Task=`70b4ca2d-37b2-4ec8-95d0-0d9a883c875e`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000307238', 'lastCheck': '6.2', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000310993', 'lastCheck': '6.1', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:46:23,450::task::595::Storage.TaskManager.Task::(_updateState) Task=`70b4ca2d-37b2-4ec8-95d0-0d9a883c875e`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:46:23,451::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:46:23,451::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:46:23,451::task::993::Storage.TaskManager.Task::(_decref) Task=`70b4ca2d-37b2-4ec8-95d0-0d9a883c875e`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:46:23,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:24,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113292 s, 90.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:26,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:26,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112792 s, 90.8 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:46:27,201::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:46:27,201::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9b8a4f0-eccb-49bc-807f-8ec13262dacf`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:46:27,201::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:46:27,213::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:46:27,213::task::1191::Storage.TaskManager.Task::(prepare) Task=`f9b8a4f0-eccb-49bc-807f-8ec13262dacf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:46:27,213::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9b8a4f0-eccb-49bc-807f-8ec13262dacf`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:46:27,213::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:46:27,213::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:46:27,213::task::993::Storage.TaskManager.Task::(_decref) Task=`f9b8a4f0-eccb-49bc-807f-8ec13262dacf`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:46:27,243::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:46:27,244::task::595::Storage.TaskManager.Task::(_updateState) Task=`ceb82e79-75f6-43e3-8257-0c16b6b31b5c`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:46:27,244::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:46:27,244::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`1efaf25c-369f-4228-82d6-d1f60797d0b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:46:27,244::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:46:27,244::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:46:27,244::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`1efaf25c-369f-4228-82d6-d1f60797d0b8`::Granted request >Thread-38::DEBUG::2014-09-16 10:46:27,245::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ceb82e79-75f6-43e3-8257-0c16b6b31b5c`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:46:27,245::task::993::Storage.TaskManager.Task::(_decref) Task=`ceb82e79-75f6-43e3-8257-0c16b6b31b5c`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:46:27,257::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:46:27,257::task::1191::Storage.TaskManager.Task::(prepare) Task=`ceb82e79-75f6-43e3-8257-0c16b6b31b5c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:46:27,257::task::595::Storage.TaskManager.Task::(_updateState) Task=`ceb82e79-75f6-43e3-8257-0c16b6b31b5c`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:46:27,257::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:46:27,257::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:46:27,257::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:46:27,257::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:46:27,257::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:46:27,257::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:46:27,257::task::993::Storage.TaskManager.Task::(_decref) Task=`ceb82e79-75f6-43e3-8257-0c16b6b31b5c`::ref 0 aborting False >Thread-14::DEBUG::2014-09-16 10:46:27,289::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:27,289::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:27,289::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:27,289::__init__::232::IOProcess::(_processLogs) (40909) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:27,289::__init__::232::IOProcess::(_processLogs) (40909) Queuing response >Thread-47::DEBUG::2014-09-16 10:46:27,289::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:46:27,295::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000291971 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:46:27,296::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:27,296::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:27,296::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:27,296::__init__::232::IOProcess::(_processLogs) (40910) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:27,296::__init__::232::IOProcess::(_processLogs) (40910) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:27,360::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:27,360::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:27,360::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:27,360::__init__::232::IOProcess::(_processLogs) (40911) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:27,361::__init__::232::IOProcess::(_processLogs) (40911) Queuing response >Thread-21::DEBUG::2014-09-16 10:46:27,361::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:46:27,366::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000316069 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:46:27,367::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:27,367::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:27,367::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:27,367::__init__::232::IOProcess::(_processLogs) (40912) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:27,367::__init__::232::IOProcess::(_processLogs) (40912) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:27,368::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:27,368::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:27,368::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:27,369::__init__::232::IOProcess::(_processLogs) (40913) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:27,369::__init__::232::IOProcess::(_processLogs) (40913) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:27,369::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:27,369::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:27,369::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:27,369::__init__::232::IOProcess::(_processLogs) (40914) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:27,369::__init__::232::IOProcess::(_processLogs) (40914) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:27,370::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:27,370::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:27,370::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:27,370::__init__::232::IOProcess::(_processLogs) (40915) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:27,370::__init__::232::IOProcess::(_processLogs) (40915) Queuing response >Dummy-37::DEBUG::2014-09-16 10:46:28,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:28,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112407 s, 91.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:30,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:30,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112804 s, 90.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:32,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:32,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0111798 s, 91.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:34,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:34,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112165 s, 91.3 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:36,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-09-16 10:46:37,297::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:37,298::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:37,298::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:37,298::__init__::232::IOProcess::(_processLogs) (40916) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:37,371::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:37,371::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:37,371::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:37,371::__init__::232::IOProcess::(_processLogs) (40917) Got request for method 'statvfs' >Thread-97::DEBUG::2014-09-16 10:46:37,438::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:46:37,438::task::595::Storage.TaskManager.Task::(_updateState) Task=`826eb686-07f7-4a14-80f2-51c78204f82c`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:46:37,438::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Dummy-37::DEBUG::2014-09-16 10:46:37,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.28287 s, 798 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:46:37,588::__init__::232::IOProcess::(_processLogs) (40916) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:37,590::__init__::232::IOProcess::(_processLogs) (40917) Queuing response >Thread-47::DEBUG::2014-09-16 10:46:37,593::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-97::INFO::2014-09-16 10:46:37,599::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-21::DEBUG::2014-09-16 10:46:37,601::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-97::DEBUG::2014-09-16 10:46:37,601::task::1191::Storage.TaskManager.Task::(prepare) Task=`826eb686-07f7-4a14-80f2-51c78204f82c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-47::DEBUG::2014-09-16 10:46:37,602::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.0002313 s, 1.4 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:46:37,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`826eb686-07f7-4a14-80f2-51c78204f82c`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:46:37,610::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-21::DEBUG::2014-09-16 10:46:37,611::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000283468 s, 1.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:46:37,611::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-97::DEBUG::2014-09-16 10:46:37,611::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-16 10:46:37,613::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-97::DEBUG::2014-09-16 10:46:37,613::task::993::Storage.TaskManager.Task::(_decref) Task=`826eb686-07f7-4a14-80f2-51c78204f82c`::ref 0 aborting False >Thread-14::DEBUG::2014-09-16 10:46:37,614::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:37,615::__init__::232::IOProcess::(_processLogs) (40918) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:37,616::__init__::232::IOProcess::(_processLogs) (40918) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:37,619::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:37,621::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:37,621::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:37,622::__init__::232::IOProcess::(_processLogs) (40919) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:37,622::__init__::232::IOProcess::(_processLogs) (40919) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:37,625::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:37,626::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:37,626::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:37,626::__init__::232::IOProcess::(_processLogs) (40920) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:37,627::__init__::232::IOProcess::(_processLogs) (40920) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:37,629::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:37,629::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:37,630::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:37,630::__init__::232::IOProcess::(_processLogs) (40921) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:37,631::__init__::232::IOProcess::(_processLogs) (40921) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:37,632::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:37,633::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:37,633::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:37,634::__init__::232::IOProcess::(_processLogs) (40922) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:37,634::__init__::232::IOProcess::(_processLogs) (40922) Queuing response >Thread-38::DEBUG::2014-09-16 10:46:37,646::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:46:37,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`31c57cb5-c1fd-483f-afe1-32ede027542b`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:46:37,646::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:46:37,646::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`65b9e80b-4671-4aea-984e-48fcb4814821`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:46:37,646::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:46:37,647::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:46:37,647::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`65b9e80b-4671-4aea-984e-48fcb4814821`::Granted request >Thread-38::DEBUG::2014-09-16 10:46:37,647::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`31c57cb5-c1fd-483f-afe1-32ede027542b`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:46:37,647::task::993::Storage.TaskManager.Task::(_decref) Task=`31c57cb5-c1fd-483f-afe1-32ede027542b`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:46:37,659::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:46:37,659::task::1191::Storage.TaskManager.Task::(prepare) Task=`31c57cb5-c1fd-483f-afe1-32ede027542b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:46:37,659::task::595::Storage.TaskManager.Task::(_updateState) Task=`31c57cb5-c1fd-483f-afe1-32ede027542b`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:46:37,659::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:46:37,659::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:46:37,659::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:46:37,659::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:46:37,659::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:46:37,659::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:46:37,660::task::993::Storage.TaskManager.Task::(_decref) Task=`31c57cb5-c1fd-483f-afe1-32ede027542b`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:46:39,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-97::DEBUG::2014-09-16 10:46:39,803::task::595::Storage.TaskManager.Task::(_updateState) Task=`32eb53d1-affb-4dc2-b559-73585fb406ab`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:46:39,803::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:46:39,803::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0002313', 'lastCheck': '2.2', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000283468', 'lastCheck': '2.2', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:46:39,803::task::1191::Storage.TaskManager.Task::(prepare) Task=`32eb53d1-affb-4dc2-b559-73585fb406ab`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0002313', 'lastCheck': '2.2', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000283468', 'lastCheck': '2.2', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:46:39,804::task::595::Storage.TaskManager.Task::(_updateState) Task=`32eb53d1-affb-4dc2-b559-73585fb406ab`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:46:39,804::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:46:39,804::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:46:39,804::task::993::Storage.TaskManager.Task::(_decref) Task=`32eb53d1-affb-4dc2-b559-73585fb406ab`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:46:41,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.40695 s, 728 kB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:43,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:43,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114319 s, 89.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:45,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:45,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113276 s, 90.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:47,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:47,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115938 s, 88.3 MB/s\n'; <rc> = 0 >Thread-47::DEBUG::2014-09-16 10:46:47,621::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 97e2f375-6db7-43a3-81ad-ebbb94f94408 >Thread-14::DEBUG::2014-09-16 10:46:47,622::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:47,622::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:47,623::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:47,623::__init__::232::IOProcess::(_processLogs) (40923) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:46:47,623::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:47,623::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:47,623::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:47,623::__init__::232::IOProcess::(_processLogs) (40924) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:46:47,623::__init__::232::IOProcess::(_processLogs) (40923) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:47,624::__init__::232::IOProcess::(_processLogs) (40924) Queuing response >Thread-47::DEBUG::2014-09-16 10:46:47,625::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408 >Thread-14::DEBUG::2014-09-16 10:46:47,626::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:47,626::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:47,626::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:47,626::__init__::232::IOProcess::(_processLogs) (40925) Got request for method 'touch' >Thread-14::DEBUG::2014-09-16 10:46:47,636::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:47,636::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:47,636::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:47,637::__init__::232::IOProcess::(_processLogs) (40926) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:47,637::__init__::232::IOProcess::(_processLogs) (40926) Queuing response >Thread-21::DEBUG::2014-09-16 10:46:47,637::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-16 10:46:47,642::__init__::232::IOProcess::(_processLogs) (40925) Queuing response >Thread-21::DEBUG::2014-09-16 10:46:47,644::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000313381 s, 1.5 MB/s\n'; <rc> = 0 >Thread-47::DEBUG::2014-09-16 10:46:47,645::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14::DEBUG::2014-09-16 10:46:47,646::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:47,646::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:47,646::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:47,646::__init__::232::IOProcess::(_processLogs) (40927) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:47,646::__init__::232::IOProcess::(_processLogs) (40927) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:47,647::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:47,648::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:47,648::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:47,648::__init__::232::IOProcess::(_processLogs) (40928) Got request for method 'readfile' >Thread-14::DEBUG::2014-09-16 10:46:47,648::__init__::232::IOProcess::(_processLogs) (40928) Queuing response >Thread-47::DEBUG::2014-09-16 10:46:47,648::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=da06caa7-b08d-4685-b49c-84565c268648', 'REMOTE_PATH=10.34.63.199:/cmg02', 'ROLE=Regular', 'SDUUID=97e2f375-6db7-43a3-81ad-ebbb94f94408', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=51581838ac1d2d1538de639f6a518c57b7d75e58'] >Thread-14::DEBUG::2014-09-16 10:46:47,648::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:47,649::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:47,650::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:47,650::__init__::232::IOProcess::(_processLogs) (40929) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:47,650::__init__::232::IOProcess::(_processLogs) (40929) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:47,650::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:47,651::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:47,651::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:47,651::__init__::232::IOProcess::(_processLogs) (40930) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:47,651::__init__::232::IOProcess::(_processLogs) (40930) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:47,651::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:47,651::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:47,651::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:47,652::__init__::232::IOProcess::(_processLogs) (40931) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:47,652::__init__::232::IOProcess::(_processLogs) (40931) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:47,652::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:47,652::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:47,652::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:47,653::__init__::232::IOProcess::(_processLogs) (40932) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:46:47,653::__init__::232::IOProcess::(_processLogs) (40932) Queuing response >Thread-47::DEBUG::2014-09-16 10:46:47,653::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-14::DEBUG::2014-09-16 10:46:47,653::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-47::INFO::2014-09-16 10:46:47,653::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 97e2f375-6db7-43a3-81ad-ebbb94f94408_imageNS already registered >Thread-14::DEBUG::2014-09-16 10:46:47,654::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-47::INFO::2014-09-16 10:46:47,654::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 97e2f375-6db7-43a3-81ad-ebbb94f94408_volumeNS already registered >Thread-14::DEBUG::2014-09-16 10:46:47,654::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:47,655::__init__::232::IOProcess::(_processLogs) (40933) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:47,655::__init__::232::IOProcess::(_processLogs) (40933) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:47,655::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:47,656::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:47,656::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:47,656::__init__::232::IOProcess::(_processLogs) (40934) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:47,656::__init__::232::IOProcess::(_processLogs) (40934) Queuing response >Thread-47::DEBUG::2014-09-16 10:46:47,657::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:46:47,662::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000305056 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:46:47,663::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:47,663::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:47,663::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:47,663::__init__::232::IOProcess::(_processLogs) (40935) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:47,663::__init__::232::IOProcess::(_processLogs) (40935) Queuing response >Thread-97::DEBUG::2014-09-16 10:46:47,923::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:46:47,923::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e14e3d7-2717-4d00-b843-f98ba6f60024`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:46:47,923::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:46:47,934::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:46:47,935::task::1191::Storage.TaskManager.Task::(prepare) Task=`2e14e3d7-2717-4d00-b843-f98ba6f60024`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:46:47,935::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e14e3d7-2717-4d00-b843-f98ba6f60024`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:46:47,935::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:46:47,935::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:46:47,935::task::993::Storage.TaskManager.Task::(_decref) Task=`2e14e3d7-2717-4d00-b843-f98ba6f60024`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:46:47,964::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:46:47,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7b90c98-c472-48b2-b7f9-e2156d4cd326`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:46:47,965::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:46:47,965::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`8c3466c0-c859-40e9-83f7-9c944f8cdf28`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:46:47,965::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:46:47,965::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:46:47,965::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`8c3466c0-c859-40e9-83f7-9c944f8cdf28`::Granted request >Thread-38::DEBUG::2014-09-16 10:46:47,966::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c7b90c98-c472-48b2-b7f9-e2156d4cd326`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:46:47,966::task::993::Storage.TaskManager.Task::(_decref) Task=`c7b90c98-c472-48b2-b7f9-e2156d4cd326`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:46:47,978::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:46:47,978::task::1191::Storage.TaskManager.Task::(prepare) Task=`c7b90c98-c472-48b2-b7f9-e2156d4cd326`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:46:47,978::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7b90c98-c472-48b2-b7f9-e2156d4cd326`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:46:47,978::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:46:47,978::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:46:47,978::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:46:47,978::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:46:47,978::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:46:47,978::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:46:47,979::task::993::Storage.TaskManager.Task::(_decref) Task=`c7b90c98-c472-48b2-b7f9-e2156d4cd326`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:46:49,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:49,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112846 s, 90.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:51,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:51,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113432 s, 90.3 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:53,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:53,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115053 s, 89.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:46:55,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:55,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113092 s, 90.5 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:46:56,255::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f75019f-2059-4672-91ac-3c9f7d05e211`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:46:56,255::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:46:56,255::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000305056', 'lastCheck': '8.6', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313381', 'lastCheck': '8.6', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:46:56,255::task::1191::Storage.TaskManager.Task::(prepare) Task=`6f75019f-2059-4672-91ac-3c9f7d05e211`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000305056', 'lastCheck': '8.6', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313381', 'lastCheck': '8.6', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:46:56,256::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f75019f-2059-4672-91ac-3c9f7d05e211`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:46:56,256::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:46:56,256::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:46:56,256::task::993::Storage.TaskManager.Task::(_decref) Task=`6f75019f-2059-4672-91ac-3c9f7d05e211`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:46:57,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:57,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112103 s, 91.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:46:57,656::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:57,657::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:57,657::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:57,657::__init__::232::IOProcess::(_processLogs) (40936) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:57,657::__init__::232::IOProcess::(_processLogs) (40936) Queuing response >Thread-21::DEBUG::2014-09-16 10:46:57,657::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:46:57,663::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000326705 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:46:57,664::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:57,664::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:57,665::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:57,665::__init__::232::IOProcess::(_processLogs) (40937) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:57,665::__init__::232::IOProcess::(_processLogs) (40937) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:57,666::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:57,666::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:57,666::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:57,666::__init__::232::IOProcess::(_processLogs) (40938) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:57,667::__init__::232::IOProcess::(_processLogs) (40938) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:57,667::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:57,668::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-47::DEBUG::2014-09-16 10:46:57,668::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-16 10:46:57,668::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:57,674::__init__::232::IOProcess::(_processLogs) (40939) Got request for method 'access' >Thread-47::DEBUG::2014-09-16 10:46:57,674::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000296079 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:46:57,675::__init__::232::IOProcess::(_processLogs) (40939) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:57,676::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:57,676::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:57,677::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:57,677::__init__::232::IOProcess::(_processLogs) (40940) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:46:57,677::__init__::232::IOProcess::(_processLogs) (40940) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:57,677::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:57,678::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:57,678::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:57,678::__init__::232::IOProcess::(_processLogs) (40941) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:57,678::__init__::232::IOProcess::(_processLogs) (40941) Queuing response >Thread-14::DEBUG::2014-09-16 10:46:57,679::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:46:57,679::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:46:57,679::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:46:57,679::__init__::232::IOProcess::(_processLogs) (40942) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:46:57,679::__init__::232::IOProcess::(_processLogs) (40942) Queuing response >Thread-97::DEBUG::2014-09-16 10:46:58,079::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:46:58,079::task::595::Storage.TaskManager.Task::(_updateState) Task=`3616f8fd-669c-42ec-a64b-0720c35117ed`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:46:58,079::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:46:58,096::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:46:58,096::task::1191::Storage.TaskManager.Task::(prepare) Task=`3616f8fd-669c-42ec-a64b-0720c35117ed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:46:58,096::task::595::Storage.TaskManager.Task::(_updateState) Task=`3616f8fd-669c-42ec-a64b-0720c35117ed`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:46:58,096::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:46:58,096::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:46:58,096::task::993::Storage.TaskManager.Task::(_decref) Task=`3616f8fd-669c-42ec-a64b-0720c35117ed`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:46:58,126::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:46:58,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`315f6392-fd54-494d-9d7b-2b1a35418933`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:46:58,127::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:46:58,127::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`aa85ac19-c683-4fd6-a497-746a067d660f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:46:58,127::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:46:58,127::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:46:58,127::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`aa85ac19-c683-4fd6-a497-746a067d660f`::Granted request >Thread-38::DEBUG::2014-09-16 10:46:58,127::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`315f6392-fd54-494d-9d7b-2b1a35418933`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:46:58,128::task::993::Storage.TaskManager.Task::(_decref) Task=`315f6392-fd54-494d-9d7b-2b1a35418933`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:46:58,139::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:46:58,139::task::1191::Storage.TaskManager.Task::(prepare) Task=`315f6392-fd54-494d-9d7b-2b1a35418933`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:46:58,140::task::595::Storage.TaskManager.Task::(_updateState) Task=`315f6392-fd54-494d-9d7b-2b1a35418933`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:46:58,140::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:46:58,140::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:46:58,140::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:46:58,140::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:46:58,140::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:46:58,140::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:46:58,140::task::993::Storage.TaskManager.Task::(_decref) Task=`315f6392-fd54-494d-9d7b-2b1a35418933`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:46:59,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:46:59,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114204 s, 89.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:47:01,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:01,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128752 s, 79.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:47:03,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:03,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113914 s, 89.9 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:47:05,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:05,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112972 s, 90.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:47:07,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-09-16 10:47:07,680::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:07,686::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:07,686::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:07,686::__init__::232::IOProcess::(_processLogs) (40943) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:07,686::__init__::232::IOProcess::(_processLogs) (40943) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:07,687::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-47::DEBUG::2014-09-16 10:47:07,688::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-16 10:47:07,688::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:07,694::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:07,694::__init__::232::IOProcess::(_processLogs) (40944) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:07,695::__init__::232::IOProcess::(_processLogs) (40944) Queuing response >Thread-47::DEBUG::2014-09-16 10:47:07,697::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000254082 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:47:07,700::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-21::DEBUG::2014-09-16 10:47:07,701::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-16 10:47:07,702::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:07,707::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-21::DEBUG::2014-09-16 10:47:07,709::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000275066 s, 1.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:47:07,709::__init__::232::IOProcess::(_processLogs) (40945) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:07,711::__init__::232::IOProcess::(_processLogs) (40945) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:07,714::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:07,715::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:07,715::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:07,716::__init__::232::IOProcess::(_processLogs) (40946) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:07,717::__init__::232::IOProcess::(_processLogs) (40946) Queuing response >Dummy-37::DEBUG::2014-09-16 10:47:07,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314054 s, 32.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:47:07,743::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:07,744::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:07,744::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:07,744::__init__::232::IOProcess::(_processLogs) (40947) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:07,745::__init__::232::IOProcess::(_processLogs) (40947) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:07,746::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:07,747::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:07,747::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:07,748::__init__::232::IOProcess::(_processLogs) (40948) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:07,748::__init__::232::IOProcess::(_processLogs) (40948) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:07,750::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:07,750::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:07,750::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:07,751::__init__::232::IOProcess::(_processLogs) (40949) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:07,751::__init__::232::IOProcess::(_processLogs) (40949) Queuing response >Thread-97::DEBUG::2014-09-16 10:47:08,331::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:47:08,331::task::595::Storage.TaskManager.Task::(_updateState) Task=`9457aaec-fdd2-45b7-832d-1d040c79ad8f`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:47:08,331::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:47:08,343::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:47:08,343::task::1191::Storage.TaskManager.Task::(prepare) Task=`9457aaec-fdd2-45b7-832d-1d040c79ad8f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:47:08,343::task::595::Storage.TaskManager.Task::(_updateState) Task=`9457aaec-fdd2-45b7-832d-1d040c79ad8f`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:47:08,343::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:47:08,343::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:47:08,343::task::993::Storage.TaskManager.Task::(_decref) Task=`9457aaec-fdd2-45b7-832d-1d040c79ad8f`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:47:08,374::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:47:08,374::task::595::Storage.TaskManager.Task::(_updateState) Task=`a343122d-f6ee-4019-8a28-5b00dd816f4b`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:47:08,374::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:47:08,374::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`f11ff517-36e4-41b9-837f-f78a2516fd03`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:47:08,374::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:47:08,374::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:47:08,374::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`f11ff517-36e4-41b9-837f-f78a2516fd03`::Granted request >Thread-38::DEBUG::2014-09-16 10:47:08,375::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a343122d-f6ee-4019-8a28-5b00dd816f4b`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:47:08,375::task::993::Storage.TaskManager.Task::(_decref) Task=`a343122d-f6ee-4019-8a28-5b00dd816f4b`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:47:08,387::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:47:08,387::task::1191::Storage.TaskManager.Task::(prepare) Task=`a343122d-f6ee-4019-8a28-5b00dd816f4b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:47:08,388::task::595::Storage.TaskManager.Task::(_updateState) Task=`a343122d-f6ee-4019-8a28-5b00dd816f4b`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:47:08,388::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:47:08,388::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:47:08,388::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:47:08,388::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:47:08,388::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:47:08,388::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:47:08,388::task::993::Storage.TaskManager.Task::(_decref) Task=`a343122d-f6ee-4019-8a28-5b00dd816f4b`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:47:09,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:09,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113667 s, 90.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:47:11,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:11,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114249 s, 89.6 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:47:11,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`62d93c36-9f49-4303-bc7a-541ef57cb6b8`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:47:11,960::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:47:11,960::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000254082', 'lastCheck': '4.2', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000275066', 'lastCheck': '4.2', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:47:11,960::task::1191::Storage.TaskManager.Task::(prepare) Task=`62d93c36-9f49-4303-bc7a-541ef57cb6b8`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000254082', 'lastCheck': '4.2', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000275066', 'lastCheck': '4.2', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:47:11,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`62d93c36-9f49-4303-bc7a-541ef57cb6b8`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:47:11,960::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:47:11,960::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:47:11,960::task::993::Storage.TaskManager.Task::(_decref) Task=`62d93c36-9f49-4303-bc7a-541ef57cb6b8`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:47:13,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:13,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113921 s, 89.9 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:47:15,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:15,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113109 s, 90.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:47:17,715::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:17,715::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:17,716::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:17,716::__init__::232::IOProcess::(_processLogs) (40950) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:17,716::__init__::232::IOProcess::(_processLogs) (40950) Queuing response >Thread-47::DEBUG::2014-09-16 10:47:17,716::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:47:17,722::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.00030189 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:47:17,722::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:17,723::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:17,723::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:17,723::__init__::232::IOProcess::(_processLogs) (40951) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:17,723::__init__::232::IOProcess::(_processLogs) (40951) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:17,753::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:17,753::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:17,753::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:17,753::__init__::232::IOProcess::(_processLogs) (40952) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:17,753::__init__::232::IOProcess::(_processLogs) (40952) Queuing response >Thread-21::DEBUG::2014-09-16 10:47:17,754::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:47:17,759::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000312216 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:47:17,760::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:17,760::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:17,760::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:17,760::__init__::232::IOProcess::(_processLogs) (40953) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:17,760::__init__::232::IOProcess::(_processLogs) (40953) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:17,761::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:17,761::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:17,761::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:17,761::__init__::232::IOProcess::(_processLogs) (40954) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:17,761::__init__::232::IOProcess::(_processLogs) (40954) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:17,762::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:17,762::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:17,762::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:17,762::__init__::232::IOProcess::(_processLogs) (40955) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:17,762::__init__::232::IOProcess::(_processLogs) (40955) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:17,763::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:17,763::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:17,763::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:17,763::__init__::232::IOProcess::(_processLogs) (40956) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:17,763::__init__::232::IOProcess::(_processLogs) (40956) Queuing response >Dummy-37::DEBUG::2014-09-16 10:47:17,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:18,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113116 s, 90.5 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:47:18,650::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:47:18,651::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c090a2c-0a7a-4c5d-87f4-876a105eb6ca`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:47:18,651::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:47:18,662::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:47:18,662::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c090a2c-0a7a-4c5d-87f4-876a105eb6ca`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:47:18,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c090a2c-0a7a-4c5d-87f4-876a105eb6ca`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:47:18,662::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:47:18,663::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:47:18,663::task::993::Storage.TaskManager.Task::(_decref) Task=`3c090a2c-0a7a-4c5d-87f4-876a105eb6ca`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:47:18,691::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:47:18,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`468c3053-0314-4805-add4-d093cf42707a`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:47:18,692::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:47:18,692::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`bf6528ff-1f2b-4234-af8c-18b3c9a4fb57`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:47:18,692::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:47:18,692::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:47:18,692::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`bf6528ff-1f2b-4234-af8c-18b3c9a4fb57`::Granted request >Thread-38::DEBUG::2014-09-16 10:47:18,693::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`468c3053-0314-4805-add4-d093cf42707a`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:47:18,693::task::993::Storage.TaskManager.Task::(_decref) Task=`468c3053-0314-4805-add4-d093cf42707a`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:47:18,705::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:47:18,705::task::1191::Storage.TaskManager.Task::(prepare) Task=`468c3053-0314-4805-add4-d093cf42707a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:47:18,705::task::595::Storage.TaskManager.Task::(_updateState) Task=`468c3053-0314-4805-add4-d093cf42707a`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:47:18,705::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:47:18,705::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:47:18,705::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:47:18,705::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:47:18,705::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:47:18,705::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:47:18,706::task::993::Storage.TaskManager.Task::(_decref) Task=`468c3053-0314-4805-add4-d093cf42707a`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:47:20,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:20,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113827 s, 90.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:47:22,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:22,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112804 s, 90.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:47:24,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:24,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113325 s, 90.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:47:26,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:26,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113338 s, 90.3 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:47:27,516::task::595::Storage.TaskManager.Task::(_updateState) Task=`44bb9e83-2de3-48b3-8e68-6bb32a5a15a0`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:47:27,516::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:47:27,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00030189', 'lastCheck': '9.8', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000312216', 'lastCheck': '9.8', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:47:27,517::task::1191::Storage.TaskManager.Task::(prepare) Task=`44bb9e83-2de3-48b3-8e68-6bb32a5a15a0`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00030189', 'lastCheck': '9.8', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000312216', 'lastCheck': '9.8', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:47:27,517::task::595::Storage.TaskManager.Task::(_updateState) Task=`44bb9e83-2de3-48b3-8e68-6bb32a5a15a0`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:47:27,517::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:47:27,517::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:47:27,517::task::993::Storage.TaskManager.Task::(_decref) Task=`44bb9e83-2de3-48b3-8e68-6bb32a5a15a0`::ref 0 aborting False >Thread-14::DEBUG::2014-09-16 10:47:27,724::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:27,724::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:27,724::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:27,724::__init__::232::IOProcess::(_processLogs) (40957) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:27,724::__init__::232::IOProcess::(_processLogs) (40957) Queuing response >Thread-47::DEBUG::2014-09-16 10:47:27,725::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:47:27,730::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000295331 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:47:27,731::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:27,731::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:27,731::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:27,731::__init__::232::IOProcess::(_processLogs) (40958) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:27,732::__init__::232::IOProcess::(_processLogs) (40958) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:27,764::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:27,764::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:27,764::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:27,764::__init__::232::IOProcess::(_processLogs) (40959) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:27,764::__init__::232::IOProcess::(_processLogs) (40959) Queuing response >Thread-21::DEBUG::2014-09-16 10:47:27,765::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:47:27,770::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000317172 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:47:27,771::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:27,771::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:27,771::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:27,771::__init__::232::IOProcess::(_processLogs) (40960) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:27,771::__init__::232::IOProcess::(_processLogs) (40960) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:27,772::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:27,772::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:27,772::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:27,772::__init__::232::IOProcess::(_processLogs) (40961) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:27,772::__init__::232::IOProcess::(_processLogs) (40961) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:27,773::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:27,773::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:27,773::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:27,773::__init__::232::IOProcess::(_processLogs) (40962) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:27,773::__init__::232::IOProcess::(_processLogs) (40962) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:27,774::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:27,774::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:27,774::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:27,774::__init__::232::IOProcess::(_processLogs) (40963) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:27,774::__init__::232::IOProcess::(_processLogs) (40963) Queuing response >Dummy-37::DEBUG::2014-09-16 10:47:28,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:28,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113889 s, 89.9 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:47:29,288::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:47:29,289::task::595::Storage.TaskManager.Task::(_updateState) Task=`293fc7cf-2fa8-4e5c-a94d-efe7e4e4c90d`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:47:29,289::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:47:29,300::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:47:29,300::task::1191::Storage.TaskManager.Task::(prepare) Task=`293fc7cf-2fa8-4e5c-a94d-efe7e4e4c90d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:47:29,300::task::595::Storage.TaskManager.Task::(_updateState) Task=`293fc7cf-2fa8-4e5c-a94d-efe7e4e4c90d`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:47:29,300::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:47:29,300::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:47:29,301::task::993::Storage.TaskManager.Task::(_decref) Task=`293fc7cf-2fa8-4e5c-a94d-efe7e4e4c90d`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:47:29,331::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:47:29,331::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c4838cb-70f2-457f-8f94-bfaff0b842d6`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:47:29,331::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:47:29,331::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`c121ee49-867a-4597-a6ad-6414f13a15dc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:47:29,331::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:47:29,332::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:47:29,332::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`c121ee49-867a-4597-a6ad-6414f13a15dc`::Granted request >Thread-38::DEBUG::2014-09-16 10:47:29,332::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0c4838cb-70f2-457f-8f94-bfaff0b842d6`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:47:29,332::task::993::Storage.TaskManager.Task::(_decref) Task=`0c4838cb-70f2-457f-8f94-bfaff0b842d6`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:47:29,344::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:47:29,344::task::1191::Storage.TaskManager.Task::(prepare) Task=`0c4838cb-70f2-457f-8f94-bfaff0b842d6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:47:29,344::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c4838cb-70f2-457f-8f94-bfaff0b842d6`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:47:29,344::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:47:29,344::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:47:29,344::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:47:29,345::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:47:29,345::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:47:29,345::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:47:29,345::task::993::Storage.TaskManager.Task::(_decref) Task=`0c4838cb-70f2-457f-8f94-bfaff0b842d6`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:47:30,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:30,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011354 s, 90.2 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:47:32,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:32,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112764 s, 90.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:47:34,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:34,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113494 s, 90.2 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:47:36,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:36,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113035 s, 90.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:47:37,733::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:37,733::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:37,733::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:37,733::__init__::232::IOProcess::(_processLogs) (40964) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:37,733::__init__::232::IOProcess::(_processLogs) (40964) Queuing response >Thread-47::DEBUG::2014-09-16 10:47:37,734::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:47:37,739::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.00034173 s, 951 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:47:37,740::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:37,740::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:37,740::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:37,740::__init__::232::IOProcess::(_processLogs) (40965) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:37,740::__init__::232::IOProcess::(_processLogs) (40965) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:37,775::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:37,775::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:37,775::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:37,775::__init__::232::IOProcess::(_processLogs) (40966) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:37,775::__init__::232::IOProcess::(_processLogs) (40966) Queuing response >Thread-21::DEBUG::2014-09-16 10:47:37,776::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:47:37,781::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000272001 s, 1.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:47:37,782::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:37,782::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:37,782::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:37,782::__init__::232::IOProcess::(_processLogs) (40967) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:37,782::__init__::232::IOProcess::(_processLogs) (40967) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:37,783::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:37,783::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:37,783::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:37,783::__init__::232::IOProcess::(_processLogs) (40968) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:37,784::__init__::232::IOProcess::(_processLogs) (40968) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:37,784::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:37,784::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:37,784::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:37,784::__init__::232::IOProcess::(_processLogs) (40969) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:37,784::__init__::232::IOProcess::(_processLogs) (40969) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:37,785::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:37,785::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:37,785::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:37,785::__init__::232::IOProcess::(_processLogs) (40970) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:37,785::__init__::232::IOProcess::(_processLogs) (40970) Queuing response >Dummy-37::DEBUG::2014-09-16 10:47:38,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:38,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112763 s, 90.8 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:47:39,676::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:47:39,677::task::595::Storage.TaskManager.Task::(_updateState) Task=`7784bb78-2eb0-40ef-b41d-aa4fe59c8ede`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:47:39,677::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:47:39,688::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:47:39,688::task::1191::Storage.TaskManager.Task::(prepare) Task=`7784bb78-2eb0-40ef-b41d-aa4fe59c8ede`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:47:39,688::task::595::Storage.TaskManager.Task::(_updateState) Task=`7784bb78-2eb0-40ef-b41d-aa4fe59c8ede`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:47:39,689::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:47:39,689::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:47:39,689::task::993::Storage.TaskManager.Task::(_decref) Task=`7784bb78-2eb0-40ef-b41d-aa4fe59c8ede`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:47:39,719::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:47:39,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`476c0f2a-041a-4b27-bfd3-e574dfd8a880`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:47:39,719::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:47:39,719::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`c9fb3b87-7b18-40e2-b6a5-ab8a95a03248`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:47:39,719::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:47:39,720::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:47:39,720::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`c9fb3b87-7b18-40e2-b6a5-ab8a95a03248`::Granted request >Thread-38::DEBUG::2014-09-16 10:47:39,720::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`476c0f2a-041a-4b27-bfd3-e574dfd8a880`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:47:39,720::task::993::Storage.TaskManager.Task::(_decref) Task=`476c0f2a-041a-4b27-bfd3-e574dfd8a880`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:47:39,732::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:47:39,732::task::1191::Storage.TaskManager.Task::(prepare) Task=`476c0f2a-041a-4b27-bfd3-e574dfd8a880`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:47:39,732::task::595::Storage.TaskManager.Task::(_updateState) Task=`476c0f2a-041a-4b27-bfd3-e574dfd8a880`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:47:39,732::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:47:39,732::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:47:39,732::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:47:39,733::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:47:39,733::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:47:39,733::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:47:39,733::task::993::Storage.TaskManager.Task::(_decref) Task=`476c0f2a-041a-4b27-bfd3-e574dfd8a880`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:47:40,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:40,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011447 s, 89.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:47:42,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:42,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112947 s, 90.7 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:47:43,488::task::595::Storage.TaskManager.Task::(_updateState) Task=`99a84341-eb57-467d-b252-376bee5f6ef9`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:47:43,488::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:47:43,488::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00034173', 'lastCheck': '5.7', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272001', 'lastCheck': '5.7', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:47:43,488::task::1191::Storage.TaskManager.Task::(prepare) Task=`99a84341-eb57-467d-b252-376bee5f6ef9`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00034173', 'lastCheck': '5.7', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272001', 'lastCheck': '5.7', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:47:43,488::task::595::Storage.TaskManager.Task::(_updateState) Task=`99a84341-eb57-467d-b252-376bee5f6ef9`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:47:43,488::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:47:43,488::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:47:43,488::task::993::Storage.TaskManager.Task::(_decref) Task=`99a84341-eb57-467d-b252-376bee5f6ef9`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:47:44,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:44,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.020078 s, 51.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:47:46,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:46,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112472 s, 91.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:47:47,742::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:47,742::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:47,742::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:47,742::__init__::232::IOProcess::(_processLogs) (40971) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:47,742::__init__::232::IOProcess::(_processLogs) (40971) Queuing response >Thread-47::DEBUG::2014-09-16 10:47:47,743::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:47:47,748::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000302983 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:47:47,749::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:47,749::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:47,749::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:47,749::__init__::232::IOProcess::(_processLogs) (40972) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:47,749::__init__::232::IOProcess::(_processLogs) (40972) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:47,786::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:47,786::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:47,786::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:47,786::__init__::232::IOProcess::(_processLogs) (40973) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:47,786::__init__::232::IOProcess::(_processLogs) (40973) Queuing response >Thread-21::DEBUG::2014-09-16 10:47:47,787::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:47:47,792::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000331376 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:47:47,793::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:47,793::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:47,793::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:47,793::__init__::232::IOProcess::(_processLogs) (40974) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:47,793::__init__::232::IOProcess::(_processLogs) (40974) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:47,794::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:47,794::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:47,794::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:47,794::__init__::232::IOProcess::(_processLogs) (40975) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:47,795::__init__::232::IOProcess::(_processLogs) (40975) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:47,795::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:47,795::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:47,795::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:47,795::__init__::232::IOProcess::(_processLogs) (40976) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:47,795::__init__::232::IOProcess::(_processLogs) (40976) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:47,796::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:47,796::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:47,796::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:47,796::__init__::232::IOProcess::(_processLogs) (40977) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:47,796::__init__::232::IOProcess::(_processLogs) (40977) Queuing response >Dummy-37::DEBUG::2014-09-16 10:47:48,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:48,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112584 s, 91.0 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:47:50,397::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:47:50,398::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a8f1326-ea27-4442-94bb-0962b0064c38`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:47:50,398::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:47:50,409::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:47:50,409::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a8f1326-ea27-4442-94bb-0962b0064c38`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:47:50,409::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a8f1326-ea27-4442-94bb-0962b0064c38`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:47:50,409::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:47:50,409::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:47:50,409::task::993::Storage.TaskManager.Task::(_decref) Task=`3a8f1326-ea27-4442-94bb-0962b0064c38`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:47:50,444::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:47:50,445::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ab65535-8d0d-458c-9f04-b3757b324cb9`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:47:50,445::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:47:50,445::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`6b6ca6b9-c93c-43c4-a567-4ed441468540`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:47:50,445::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:47:50,445::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:47:50,445::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`6b6ca6b9-c93c-43c4-a567-4ed441468540`::Granted request >Thread-38::DEBUG::2014-09-16 10:47:50,446::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3ab65535-8d0d-458c-9f04-b3757b324cb9`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:47:50,446::task::993::Storage.TaskManager.Task::(_decref) Task=`3ab65535-8d0d-458c-9f04-b3757b324cb9`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:47:50,457::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:47:50,458::task::1191::Storage.TaskManager.Task::(prepare) Task=`3ab65535-8d0d-458c-9f04-b3757b324cb9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:47:50,458::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ab65535-8d0d-458c-9f04-b3757b324cb9`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:47:50,458::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:47:50,458::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:47:50,458::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:47:50,458::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:47:50,458::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:47:50,458::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:47:50,458::task::993::Storage.TaskManager.Task::(_decref) Task=`3ab65535-8d0d-458c-9f04-b3757b324cb9`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:47:50,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:50,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112565 s, 91.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:47:52,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:52,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112721 s, 90.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:47:54,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:55,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0111902 s, 91.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:47:57,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:57,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112366 s, 91.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:47:57,751::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:57,751::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:57,751::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:57,751::__init__::232::IOProcess::(_processLogs) (40978) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:57,751::__init__::232::IOProcess::(_processLogs) (40978) Queuing response >Thread-47::DEBUG::2014-09-16 10:47:57,752::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:47:57,757::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000309838 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:47:57,758::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:57,758::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:57,758::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:57,758::__init__::232::IOProcess::(_processLogs) (40979) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:57,758::__init__::232::IOProcess::(_processLogs) (40979) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:57,797::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:57,797::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:57,797::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:57,797::__init__::232::IOProcess::(_processLogs) (40980) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:57,797::__init__::232::IOProcess::(_processLogs) (40980) Queuing response >Thread-21::DEBUG::2014-09-16 10:47:57,798::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:47:57,803::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000301954 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:47:57,804::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:57,804::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:57,804::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:57,804::__init__::232::IOProcess::(_processLogs) (40981) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:47:57,804::__init__::232::IOProcess::(_processLogs) (40981) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:57,805::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:57,805::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:57,805::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:57,805::__init__::232::IOProcess::(_processLogs) (40982) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:57,805::__init__::232::IOProcess::(_processLogs) (40982) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:57,806::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:57,806::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:57,806::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:57,806::__init__::232::IOProcess::(_processLogs) (40983) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:57,806::__init__::232::IOProcess::(_processLogs) (40983) Queuing response >Thread-14::DEBUG::2014-09-16 10:47:57,807::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:47:57,807::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:47:57,807::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:47:57,807::__init__::232::IOProcess::(_processLogs) (40984) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:47:57,807::__init__::232::IOProcess::(_processLogs) (40984) Queuing response >Dummy-37::DEBUG::2014-09-16 10:47:59,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:47:59,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011252 s, 91.0 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:47:59,149::task::595::Storage.TaskManager.Task::(_updateState) Task=`5dea345f-b1a0-4395-9aeb-6e54215e65f9`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:47:59,149::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:47:59,149::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000309838', 'lastCheck': '1.4', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000301954', 'lastCheck': '1.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:47:59,149::task::1191::Storage.TaskManager.Task::(prepare) Task=`5dea345f-b1a0-4395-9aeb-6e54215e65f9`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000309838', 'lastCheck': '1.4', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000301954', 'lastCheck': '1.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:47:59,149::task::595::Storage.TaskManager.Task::(_updateState) Task=`5dea345f-b1a0-4395-9aeb-6e54215e65f9`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:47:59,150::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:47:59,150::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:47:59,150::task::993::Storage.TaskManager.Task::(_decref) Task=`5dea345f-b1a0-4395-9aeb-6e54215e65f9`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:48:01,025::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:48:01,025::task::595::Storage.TaskManager.Task::(_updateState) Task=`01d8afd4-4b55-42ca-b0d8-a67ce8033b70`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:48:01,025::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:48:01,036::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:48:01,036::task::1191::Storage.TaskManager.Task::(prepare) Task=`01d8afd4-4b55-42ca-b0d8-a67ce8033b70`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:48:01,036::task::595::Storage.TaskManager.Task::(_updateState) Task=`01d8afd4-4b55-42ca-b0d8-a67ce8033b70`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:48:01,036::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:48:01,037::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:48:01,037::task::993::Storage.TaskManager.Task::(_decref) Task=`01d8afd4-4b55-42ca-b0d8-a67ce8033b70`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:48:01,069::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:48:01,069::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebc2b352-48fc-41d5-892b-88eac354e702`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:48:01,069::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:48:01,069::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`ed528836-47fc-4156-bdbc-248b2a8b4c6f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:48:01,069::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:48:01,070::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:48:01,070::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`ed528836-47fc-4156-bdbc-248b2a8b4c6f`::Granted request >Thread-38::DEBUG::2014-09-16 10:48:01,070::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ebc2b352-48fc-41d5-892b-88eac354e702`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:48:01,070::task::993::Storage.TaskManager.Task::(_decref) Task=`ebc2b352-48fc-41d5-892b-88eac354e702`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:48:01,082::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:48:01,082::task::1191::Storage.TaskManager.Task::(prepare) Task=`ebc2b352-48fc-41d5-892b-88eac354e702`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:48:01,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebc2b352-48fc-41d5-892b-88eac354e702`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:48:01,082::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:48:01,082::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:48:01,082::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:48:01,083::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:48:01,083::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:48:01,083::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:48:01,083::task::993::Storage.TaskManager.Task::(_decref) Task=`ebc2b352-48fc-41d5-892b-88eac354e702`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:48:01,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:01,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112506 s, 91.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:48:03,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:03,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112498 s, 91.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:48:05,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:05,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113006 s, 90.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:48:07,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:07,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112144 s, 91.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:48:07,759::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:07,760::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:07,760::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:07,760::__init__::232::IOProcess::(_processLogs) (40985) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:07,760::__init__::232::IOProcess::(_processLogs) (40985) Queuing response >Thread-47::DEBUG::2014-09-16 10:48:07,760::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:48:07,766::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000298623 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:48:07,767::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:07,767::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:07,767::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:07,767::__init__::232::IOProcess::(_processLogs) (40986) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:07,767::__init__::232::IOProcess::(_processLogs) (40986) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:07,808::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:07,808::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:07,808::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:07,808::__init__::232::IOProcess::(_processLogs) (40987) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:07,808::__init__::232::IOProcess::(_processLogs) (40987) Queuing response >Thread-21::DEBUG::2014-09-16 10:48:07,809::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:48:07,814::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000385315 s, 1.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:48:07,815::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:07,815::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:07,815::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:07,816::__init__::232::IOProcess::(_processLogs) (40988) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:07,816::__init__::232::IOProcess::(_processLogs) (40988) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:07,816::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:07,816::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:07,817::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:07,817::__init__::232::IOProcess::(_processLogs) (40989) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:07,817::__init__::232::IOProcess::(_processLogs) (40989) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:07,818::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:07,818::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:07,818::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:07,818::__init__::232::IOProcess::(_processLogs) (40990) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:07,818::__init__::232::IOProcess::(_processLogs) (40990) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:07,818::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:07,818::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:07,819::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:07,819::__init__::232::IOProcess::(_processLogs) (40991) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:07,819::__init__::232::IOProcess::(_processLogs) (40991) Queuing response >Dummy-37::DEBUG::2014-09-16 10:48:09,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:09,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112496 s, 91.0 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:48:11,282::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:48:11,282::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e25edad-7258-487d-941c-43e9d2b14e7a`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:48:11,282::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:48:11,294::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:48:11,294::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e25edad-7258-487d-941c-43e9d2b14e7a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:48:11,294::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e25edad-7258-487d-941c-43e9d2b14e7a`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:48:11,294::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:48:11,294::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:48:11,294::task::993::Storage.TaskManager.Task::(_decref) Task=`3e25edad-7258-487d-941c-43e9d2b14e7a`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:48:11,328::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:48:11,328::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1ba74d0-e637-4e00-a28f-982f148c8aef`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:48:11,329::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:48:11,329::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`e94f606e-8729-43f7-a3b4-4653a8809c22`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:48:11,329::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:48:11,329::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:48:11,329::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`e94f606e-8729-43f7-a3b4-4653a8809c22`::Granted request >Thread-38::DEBUG::2014-09-16 10:48:11,329::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a1ba74d0-e637-4e00-a28f-982f148c8aef`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:48:11,329::task::993::Storage.TaskManager.Task::(_decref) Task=`a1ba74d0-e637-4e00-a28f-982f148c8aef`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:48:11,341::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:48:11,342::task::1191::Storage.TaskManager.Task::(prepare) Task=`a1ba74d0-e637-4e00-a28f-982f148c8aef`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:48:11,342::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1ba74d0-e637-4e00-a28f-982f148c8aef`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:48:11,342::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:48:11,342::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:48:11,342::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:48:11,342::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:48:11,342::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:48:11,342::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:48:11,342::task::993::Storage.TaskManager.Task::(_decref) Task=`a1ba74d0-e637-4e00-a28f-982f148c8aef`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:48:11,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:11,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112322 s, 91.2 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:48:13,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:13,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0111167 s, 92.1 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:48:14,517::task::595::Storage.TaskManager.Task::(_updateState) Task=`4df58b66-b324-46b9-96a6-eba42f6f40ed`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:48:14,518::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:48:14,520::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000298623', 'lastCheck': '6.8', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385315', 'lastCheck': '6.7', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:48:14,520::task::1191::Storage.TaskManager.Task::(prepare) Task=`4df58b66-b324-46b9-96a6-eba42f6f40ed`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000298623', 'lastCheck': '6.8', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385315', 'lastCheck': '6.7', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:48:14,521::task::595::Storage.TaskManager.Task::(_updateState) Task=`4df58b66-b324-46b9-96a6-eba42f6f40ed`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:48:14,521::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:48:14,522::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:48:14,523::task::993::Storage.TaskManager.Task::(_decref) Task=`4df58b66-b324-46b9-96a6-eba42f6f40ed`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:48:15,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:15,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113822 s, 90.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:48:17,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:17,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113 s, 90.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:48:17,769::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:17,769::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:17,769::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:17,769::__init__::232::IOProcess::(_processLogs) (40992) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:17,769::__init__::232::IOProcess::(_processLogs) (40992) Queuing response >Thread-47::DEBUG::2014-09-16 10:48:17,770::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:48:17,775::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.00029919 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:48:17,776::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:17,776::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:17,776::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:17,776::__init__::232::IOProcess::(_processLogs) (40993) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:17,776::__init__::232::IOProcess::(_processLogs) (40993) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:17,820::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:17,820::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:17,820::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:17,820::__init__::232::IOProcess::(_processLogs) (40994) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:17,820::__init__::232::IOProcess::(_processLogs) (40994) Queuing response >Thread-21::DEBUG::2014-09-16 10:48:17,821::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:48:17,826::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000349108 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:48:17,827::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:17,827::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:17,827::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:17,827::__init__::232::IOProcess::(_processLogs) (40995) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:17,827::__init__::232::IOProcess::(_processLogs) (40995) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:17,828::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:17,828::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:17,828::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:17,828::__init__::232::IOProcess::(_processLogs) (40996) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:17,828::__init__::232::IOProcess::(_processLogs) (40996) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:17,829::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:17,829::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:17,829::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:17,829::__init__::232::IOProcess::(_processLogs) (40997) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:17,829::__init__::232::IOProcess::(_processLogs) (40997) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:17,829::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:17,830::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:17,830::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:17,830::__init__::232::IOProcess::(_processLogs) (40998) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:17,830::__init__::232::IOProcess::(_processLogs) (40998) Queuing response >Dummy-37::DEBUG::2014-09-16 10:48:19,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:19,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112892 s, 90.7 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:48:21,516::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:48:21,517::task::595::Storage.TaskManager.Task::(_updateState) Task=`898aea60-d808-462e-9d7a-c43375b3c16b`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:48:21,517::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:48:21,529::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:48:21,529::task::1191::Storage.TaskManager.Task::(prepare) Task=`898aea60-d808-462e-9d7a-c43375b3c16b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:48:21,529::task::595::Storage.TaskManager.Task::(_updateState) Task=`898aea60-d808-462e-9d7a-c43375b3c16b`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:48:21,529::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:48:21,529::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:48:21,529::task::993::Storage.TaskManager.Task::(_decref) Task=`898aea60-d808-462e-9d7a-c43375b3c16b`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:48:21,562::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:48:21,562::task::595::Storage.TaskManager.Task::(_updateState) Task=`76b9a2f4-3ad4-4b78-93c1-89aefb489d1b`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:48:21,562::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:48:21,562::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`beaf5eaf-3d7d-4da3-b0ef-b20cc090c51f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:48:21,562::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:48:21,563::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:48:21,563::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`beaf5eaf-3d7d-4da3-b0ef-b20cc090c51f`::Granted request >Thread-38::DEBUG::2014-09-16 10:48:21,563::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`76b9a2f4-3ad4-4b78-93c1-89aefb489d1b`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:48:21,563::task::993::Storage.TaskManager.Task::(_decref) Task=`76b9a2f4-3ad4-4b78-93c1-89aefb489d1b`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:48:21,575::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:48:21,575::task::1191::Storage.TaskManager.Task::(prepare) Task=`76b9a2f4-3ad4-4b78-93c1-89aefb489d1b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:48:21,575::task::595::Storage.TaskManager.Task::(_updateState) Task=`76b9a2f4-3ad4-4b78-93c1-89aefb489d1b`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:48:21,575::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:48:21,575::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:48:21,575::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:48:21,576::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:48:21,576::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:48:21,576::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:48:21,576::task::993::Storage.TaskManager.Task::(_decref) Task=`76b9a2f4-3ad4-4b78-93c1-89aefb489d1b`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:48:21,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:21,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113639 s, 90.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:48:23,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:23,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112463 s, 91.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:48:25,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:25,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112175 s, 91.3 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:48:27,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:27,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115599 s, 88.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:48:27,796::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:27,797::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:27,797::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:27,798::__init__::232::IOProcess::(_processLogs) (40999) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:27,798::__init__::232::IOProcess::(_processLogs) (40999) Queuing response >Thread-47::DEBUG::2014-09-16 10:48:27,802::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:48:27,808::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000250592 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:48:27,810::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:27,811::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:27,811::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:27,811::__init__::232::IOProcess::(_processLogs) (41000) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:27,811::__init__::232::IOProcess::(_processLogs) (41000) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:27,831::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:27,831::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:27,831::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:27,831::__init__::232::IOProcess::(_processLogs) (41001) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:27,831::__init__::232::IOProcess::(_processLogs) (41001) Queuing response >Thread-21::DEBUG::2014-09-16 10:48:27,832::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:48:27,837::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000348313 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:48:27,838::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:27,838::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:27,838::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:27,838::__init__::232::IOProcess::(_processLogs) (41002) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:27,838::__init__::232::IOProcess::(_processLogs) (41002) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:27,839::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:27,839::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:27,839::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:27,839::__init__::232::IOProcess::(_processLogs) (41003) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:27,839::__init__::232::IOProcess::(_processLogs) (41003) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:27,840::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:27,840::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:27,840::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:27,840::__init__::232::IOProcess::(_processLogs) (41004) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:27,840::__init__::232::IOProcess::(_processLogs) (41004) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:27,841::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:27,841::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:27,841::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:27,841::__init__::232::IOProcess::(_processLogs) (41005) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:27,841::__init__::232::IOProcess::(_processLogs) (41005) Queuing response >Dummy-37::DEBUG::2014-09-16 10:48:29,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:29,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113586 s, 90.2 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:48:30,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5aa332e-613c-49ad-9811-d10648dae2f9`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:48:30,013::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:48:30,013::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000250592', 'lastCheck': '2.2', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348313', 'lastCheck': '2.2', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:48:30,013::task::1191::Storage.TaskManager.Task::(prepare) Task=`c5aa332e-613c-49ad-9811-d10648dae2f9`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000250592', 'lastCheck': '2.2', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348313', 'lastCheck': '2.2', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:48:30,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5aa332e-613c-49ad-9811-d10648dae2f9`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:48:30,013::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:48:30,013::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:48:30,014::task::993::Storage.TaskManager.Task::(_decref) Task=`c5aa332e-613c-49ad-9811-d10648dae2f9`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:48:31,694::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:48:31,694::task::595::Storage.TaskManager.Task::(_updateState) Task=`d28bad1c-0444-471d-b8a1-e2b54541cf77`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:48:31,695::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:48:31,706::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:48:31,706::task::1191::Storage.TaskManager.Task::(prepare) Task=`d28bad1c-0444-471d-b8a1-e2b54541cf77`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:48:31,706::task::595::Storage.TaskManager.Task::(_updateState) Task=`d28bad1c-0444-471d-b8a1-e2b54541cf77`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:48:31,706::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:48:31,706::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:48:31,706::task::993::Storage.TaskManager.Task::(_decref) Task=`d28bad1c-0444-471d-b8a1-e2b54541cf77`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:48:31,736::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:48:31,736::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d5afc69-f5f0-466d-9357-b8a964013a64`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:48:31,736::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:48:31,736::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`f1f88879-0ffc-4e4c-a08c-4a3c7768236c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:48:31,736::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:48:31,736::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:48:31,737::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`f1f88879-0ffc-4e4c-a08c-4a3c7768236c`::Granted request >Thread-38::DEBUG::2014-09-16 10:48:31,737::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3d5afc69-f5f0-466d-9357-b8a964013a64`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:48:31,737::task::993::Storage.TaskManager.Task::(_decref) Task=`3d5afc69-f5f0-466d-9357-b8a964013a64`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:48:31,749::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:48:31,749::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d5afc69-f5f0-466d-9357-b8a964013a64`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134665666560', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:48:31,749::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d5afc69-f5f0-466d-9357-b8a964013a64`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:48:31,749::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:48:31,749::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:48:31,749::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:48:31,749::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:48:31,749::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:48:31,749::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:48:31,750::task::993::Storage.TaskManager.Task::(_decref) Task=`3d5afc69-f5f0-466d-9357-b8a964013a64`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:48:31,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:31,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113968 s, 89.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:48:33,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:33,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113472 s, 90.2 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:48:35,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:36,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113873 s, 89.9 MB/s\n'; <rc> = 0 >Thread-38::DEBUG::2014-09-16 10:48:37,126::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] flowID [4a2a61c3] >Thread-38::DEBUG::2014-09-16 10:48:37,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:48:37,126::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='b66bf4f1-94ad-487c-aa76-34598a679d7b', spUUID='da06caa7-b08d-4685-b49c-84565c268648', imgUUID='3656d61b-3977-47c7-9650-f9ba002d07ce', size='2147483648', volFormat=5, preallocate=1, diskType=2, volUUID='138a98f3-839e-41b0-9c72-0dae737ad838', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-38::DEBUG::2014-09-16 10:48:37,127::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b`ReqID=`519a2bc4-89b5-47d5-90ac-96ae9e1b99c0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1458' at 'createVolume' >Thread-38::DEBUG::2014-09-16 10:48:37,127::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:48:37,127::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:48:37,127::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b`ReqID=`519a2bc4-89b5-47d5-90ac-96ae9e1b99c0`::Granted request >Thread-38::DEBUG::2014-09-16 10:48:37,127::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::_resourcesAcquired: Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b (shared) >Thread-38::DEBUG::2014-09-16 10:48:37,128::task::993::Storage.TaskManager.Task::(_decref) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::ref 1 aborting False >Thread-14::DEBUG::2014-09-16 10:48:37,128::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,128::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,128::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,128::__init__::232::IOProcess::(_processLogs) (41006) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:48:37,128::__init__::232::IOProcess::(_processLogs) (41006) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,129::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,129::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,129::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,129::__init__::232::IOProcess::(_processLogs) (41007) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:48:37,129::__init__::232::IOProcess::(_processLogs) (41007) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,130::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,130::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,130::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,130::__init__::232::IOProcess::(_processLogs) (41008) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:48:37,130::__init__::232::IOProcess::(_processLogs) (41008) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,130::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,130::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,130::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,131::__init__::232::IOProcess::(_processLogs) (41009) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:48:37,131::__init__::232::IOProcess::(_processLogs) (41009) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,131::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,131::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,131::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,131::__init__::232::IOProcess::(_processLogs) (41010) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:48:37,131::__init__::232::IOProcess::(_processLogs) (41010) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,132::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,132::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,132::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,132::__init__::232::IOProcess::(_processLogs) (41011) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:48:37,132::__init__::232::IOProcess::(_processLogs) (41011) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,133::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,133::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,133::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,133::__init__::232::IOProcess::(_processLogs) (41012) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:48:37,133::__init__::232::IOProcess::(_processLogs) (41012) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,133::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,133::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,134::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,134::__init__::232::IOProcess::(_processLogs) (41013) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:48:37,135::__init__::232::IOProcess::(_processLogs) (41013) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,135::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,135::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,135::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,135::__init__::232::IOProcess::(_processLogs) (41014) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,136::__init__::232::IOProcess::(_processLogs) (41014) Queuing response >Thread-38::DEBUG::2014-09-16 10:48:37,136::task::752::Storage.TaskManager.Task::(_save) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::_save: orig /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de temp /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de.temp >Thread-14::DEBUG::2014-09-16 10:48:37,136::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,136::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,136::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,136::__init__::232::IOProcess::(_processLogs) (41015) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,136::__init__::232::IOProcess::(_processLogs) (41015) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,137::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,137::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,137::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,137::__init__::232::IOProcess::(_processLogs) (41016) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,137::__init__::232::IOProcess::(_processLogs) (41016) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,138::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,138::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,138::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,138::__init__::232::IOProcess::(_processLogs) (41017) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:48:37,138::__init__::232::IOProcess::(_processLogs) (41017) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,139::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,139::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,139::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,139::__init__::232::IOProcess::(_processLogs) (41018) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,141::__init__::232::IOProcess::(_processLogs) (41018) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,141::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,142::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,142::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,142::__init__::232::IOProcess::(_processLogs) (41019) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:48:37,142::__init__::232::IOProcess::(_processLogs) (41019) Queuing response >Thread-38::WARNING::2014-09-16 10:48:37,142::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:48:37,145::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,146::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,146::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,146::__init__::232::IOProcess::(_processLogs) (41020) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:48:37,146::__init__::232::IOProcess::(_processLogs) (41020) Queuing response >Thread-38::WARNING::2014-09-16 10:48:37,147::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:48:37,147::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,147::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,147::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,147::__init__::232::IOProcess::(_processLogs) (41021) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:48:37,148::__init__::232::IOProcess::(_processLogs) (41021) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,148::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,148::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,149::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,149::__init__::232::IOProcess::(_processLogs) (41022) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:48:37,149::__init__::232::IOProcess::(_processLogs) (41022) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,150::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,150::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,150::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,150::__init__::232::IOProcess::(_processLogs) (41023) Got request for method 'rmdir' >Thread-14::DEBUG::2014-09-16 10:48:37,150::__init__::232::IOProcess::(_processLogs) (41023) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,151::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,151::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,151::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,151::__init__::232::IOProcess::(_processLogs) (41024) Got request for method 'lexists' >Thread-14::DEBUG::2014-09-16 10:48:37,151::__init__::232::IOProcess::(_processLogs) (41024) Queuing response >Thread-38::DEBUG::2014-09-16 10:48:37,151::taskManager::78::Storage.TaskManager::(scheduleJob) scheduled job createVolume for task 7de36444-7941-4cfb-807f-f7bc274736de >Thread-38::INFO::2014-09-16 10:48:37,151::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-38::DEBUG::2014-09-16 10:48:37,151::task::1183::Storage.TaskManager.Task::(prepare) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::Prepare: 1 jobs exist, move to acquiring >Thread-38::DEBUG::2014-09-16 10:48:37,151::task::595::Storage.TaskManager.Task::(_updateState) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::moving from state preparing -> state acquiring >Thread-14::DEBUG::2014-09-16 10:48:37,152::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,152::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,152::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,152::__init__::232::IOProcess::(_processLogs) (41025) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,152::__init__::232::IOProcess::(_processLogs) (41025) Queuing response >Thread-38::DEBUG::2014-09-16 10:48:37,152::task::752::Storage.TaskManager.Task::(_save) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::_save: orig /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de temp /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de.temp >Thread-14::DEBUG::2014-09-16 10:48:37,153::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,153::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,153::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,153::__init__::232::IOProcess::(_processLogs) (41026) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,153::__init__::232::IOProcess::(_processLogs) (41026) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,153::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,154::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,154::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,154::__init__::232::IOProcess::(_processLogs) (41027) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,154::__init__::232::IOProcess::(_processLogs) (41027) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,154::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,154::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,154::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,154::__init__::232::IOProcess::(_processLogs) (41028) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:48:37,155::__init__::232::IOProcess::(_processLogs) (41028) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,155::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,155::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,155::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,156::__init__::232::IOProcess::(_processLogs) (41029) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,157::__init__::232::IOProcess::(_processLogs) (41029) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,158::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,158::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,158::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,158::__init__::232::IOProcess::(_processLogs) (41030) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,159::__init__::232::IOProcess::(_processLogs) (41030) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,160::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,160::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,160::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,160::__init__::232::IOProcess::(_processLogs) (41031) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:48:37,160::__init__::232::IOProcess::(_processLogs) (41031) Queuing response >Thread-38::WARNING::2014-09-16 10:48:37,160::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:48:37,161::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,161::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,161::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,161::__init__::232::IOProcess::(_processLogs) (41032) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:48:37,161::__init__::232::IOProcess::(_processLogs) (41032) Queuing response >Thread-38::WARNING::2014-09-16 10:48:37,162::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:48:37,162::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,162::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,162::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,162::__init__::232::IOProcess::(_processLogs) (41033) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:48:37,163::__init__::232::IOProcess::(_processLogs) (41033) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,163::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,164::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,164::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,164::__init__::232::IOProcess::(_processLogs) (41034) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:48:37,164::__init__::232::IOProcess::(_processLogs) (41034) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,165::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,165::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,165::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,165::__init__::232::IOProcess::(_processLogs) (41035) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:48:37,165::__init__::232::IOProcess::(_processLogs) (41035) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,166::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,166::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,166::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,166::__init__::232::IOProcess::(_processLogs) (41036) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:48:37,172::__init__::232::IOProcess::(_processLogs) (41036) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,172::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,172::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,172::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,172::__init__::232::IOProcess::(_processLogs) (41037) Got request for method 'rmdir' >Thread-14::DEBUG::2014-09-16 10:48:37,173::__init__::232::IOProcess::(_processLogs) (41037) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,173::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,173::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,173::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,173::__init__::232::IOProcess::(_processLogs) (41038) Got request for method 'lexists' >Thread-14::DEBUG::2014-09-16 10:48:37,174::__init__::232::IOProcess::(_processLogs) (41038) Queuing response >Thread-38::DEBUG::2014-09-16 10:48:37,174::task::595::Storage.TaskManager.Task::(_updateState) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::moving from state acquiring -> state queued >Thread-14::DEBUG::2014-09-16 10:48:37,174::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,175::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,175::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,175::__init__::232::IOProcess::(_processLogs) (41039) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,175::__init__::232::IOProcess::(_processLogs) (41039) Queuing response >Thread-38::DEBUG::2014-09-16 10:48:37,175::task::752::Storage.TaskManager.Task::(_save) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::_save: orig /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de temp /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de.temp >Thread-14::DEBUG::2014-09-16 10:48:37,175::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,175::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,175::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,176::__init__::232::IOProcess::(_processLogs) (41040) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,176::__init__::232::IOProcess::(_processLogs) (41040) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,176::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,176::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,176::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,176::__init__::232::IOProcess::(_processLogs) (41041) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,176::__init__::232::IOProcess::(_processLogs) (41041) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,177::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,177::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,177::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,177::__init__::232::IOProcess::(_processLogs) (41042) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:48:37,177::__init__::232::IOProcess::(_processLogs) (41042) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,178::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,178::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,178::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,178::__init__::232::IOProcess::(_processLogs) (41043) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,180::__init__::232::IOProcess::(_processLogs) (41043) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,180::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,180::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,180::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,180::__init__::232::IOProcess::(_processLogs) (41044) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,182::__init__::232::IOProcess::(_processLogs) (41044) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,182::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,182::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,182::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,183::__init__::232::IOProcess::(_processLogs) (41045) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:48:37,183::__init__::232::IOProcess::(_processLogs) (41045) Queuing response >Thread-38::WARNING::2014-09-16 10:48:37,183::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:48:37,183::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,183::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,183::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,183::__init__::232::IOProcess::(_processLogs) (41046) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:48:37,184::__init__::232::IOProcess::(_processLogs) (41046) Queuing response >Thread-38::WARNING::2014-09-16 10:48:37,184::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:48:37,184::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,185::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,185::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,185::__init__::232::IOProcess::(_processLogs) (41047) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:48:37,186::__init__::232::IOProcess::(_processLogs) (41047) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,186::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,186::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,186::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,186::__init__::232::IOProcess::(_processLogs) (41048) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:48:37,187::__init__::232::IOProcess::(_processLogs) (41048) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,187::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,187::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,188::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,188::__init__::232::IOProcess::(_processLogs) (41049) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:48:37,188::__init__::232::IOProcess::(_processLogs) (41049) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,188::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,188::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,188::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,189::__init__::232::IOProcess::(_processLogs) (41050) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:48:37,189::__init__::232::IOProcess::(_processLogs) (41050) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,189::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,190::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,190::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,190::__init__::232::IOProcess::(_processLogs) (41051) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:48:37,190::__init__::232::IOProcess::(_processLogs) (41051) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,190::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,191::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,191::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,191::__init__::232::IOProcess::(_processLogs) (41052) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:48:37,199::__init__::232::IOProcess::(_processLogs) (41052) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,199::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,199::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,199::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,199::__init__::232::IOProcess::(_processLogs) (41053) Got request for method 'rmdir' >Thread-14::DEBUG::2014-09-16 10:48:37,200::__init__::232::IOProcess::(_processLogs) (41053) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,200::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,200::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,200::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,200::__init__::232::IOProcess::(_processLogs) (41054) Got request for method 'lexists' >Thread-14::DEBUG::2014-09-16 10:48:37,201::__init__::232::IOProcess::(_processLogs) (41054) Queuing response >Thread-38::DEBUG::2014-09-16 10:48:37,201::taskManager::56::Storage.TaskManager::(_queueTask) queuing task: 7de36444-7941-4cfb-807f-f7bc274736de >Thread-38::DEBUG::2014-09-16 10:48:37,201::taskManager::64::Storage.TaskManager::(_queueTask) task queued: 7de36444-7941-4cfb-807f-f7bc274736de >585947a5-7581-49c6-8569-7289432f15ba::DEBUG::2014-09-16 10:48:37,201::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-38::DEBUG::2014-09-16 10:48:37,201::task::1188::Storage.TaskManager.Task::(prepare) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::returning >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:48:37,202::threadPool::200::Storage.ThreadPool.WorkerThread::(_processNextTask) Task: 7de36444-7941-4cfb-807f-f7bc274736de running: <bound method Task.commit of <storage.task.Task instance at 0x7fb75c077f80>> with: None >Thread-38::DEBUG::2014-09-16 10:48:37,202::task::993::Storage.TaskManager.Task::(_decref) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::ref 0 aborting False >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:48:37,202::task::1200::Storage.TaskManager.Task::(commit) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::committing task: 7de36444-7941-4cfb-807f-f7bc274736de >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:48:37,203::task::595::Storage.TaskManager.Task::(_updateState) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::moving from state queued -> state running >Thread-14::DEBUG::2014-09-16 10:48:37,204::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,204::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,204::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,204::__init__::232::IOProcess::(_processLogs) (41055) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,204::__init__::232::IOProcess::(_processLogs) (41055) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:48:37,204::task::752::Storage.TaskManager.Task::(_save) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::_save: orig /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de temp /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de.temp >Thread-14::DEBUG::2014-09-16 10:48:37,205::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,205::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,205::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,205::__init__::232::IOProcess::(_processLogs) (41056) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,205::__init__::232::IOProcess::(_processLogs) (41056) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,205::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,206::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,206::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,206::__init__::232::IOProcess::(_processLogs) (41057) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,206::__init__::232::IOProcess::(_processLogs) (41057) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,206::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,206::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,206::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,206::__init__::232::IOProcess::(_processLogs) (41058) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:48:37,207::__init__::232::IOProcess::(_processLogs) (41058) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,207::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,207::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,208::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,208::__init__::232::IOProcess::(_processLogs) (41059) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,209::__init__::232::IOProcess::(_processLogs) (41059) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,210::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,210::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,210::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,210::__init__::232::IOProcess::(_processLogs) (41060) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,211::__init__::232::IOProcess::(_processLogs) (41060) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,212::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,212::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,212::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,212::__init__::232::IOProcess::(_processLogs) (41061) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:48:37,212::__init__::232::IOProcess::(_processLogs) (41061) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::WARNING::2014-09-16 10:48:37,213::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:48:37,213::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,213::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,213::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,213::__init__::232::IOProcess::(_processLogs) (41062) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:48:37,214::__init__::232::IOProcess::(_processLogs) (41062) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::WARNING::2014-09-16 10:48:37,214::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:48:37,214::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,214::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,214::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,214::__init__::232::IOProcess::(_processLogs) (41063) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:48:37,222::__init__::232::IOProcess::(_processLogs) (41063) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,223::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,223::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,223::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,223::__init__::232::IOProcess::(_processLogs) (41064) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:48:37,224::__init__::232::IOProcess::(_processLogs) (41064) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,224::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,224::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,224::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,224::__init__::232::IOProcess::(_processLogs) (41065) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:48:37,224::__init__::232::IOProcess::(_processLogs) (41065) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,225::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,225::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,225::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,225::__init__::232::IOProcess::(_processLogs) (41066) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:48:37,226::__init__::232::IOProcess::(_processLogs) (41066) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,226::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,226::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,226::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,227::__init__::232::IOProcess::(_processLogs) (41067) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:48:37,227::__init__::232::IOProcess::(_processLogs) (41067) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,227::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,227::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,227::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,228::__init__::232::IOProcess::(_processLogs) (41068) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:48:37,228::__init__::232::IOProcess::(_processLogs) (41068) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,228::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,229::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,229::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,229::__init__::232::IOProcess::(_processLogs) (41069) Got request for method 'rmdir' >Thread-14::DEBUG::2014-09-16 10:48:37,229::__init__::232::IOProcess::(_processLogs) (41069) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,229::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,230::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,230::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,230::__init__::232::IOProcess::(_processLogs) (41070) Got request for method 'lexists' >Thread-14::DEBUG::2014-09-16 10:48:37,230::__init__::232::IOProcess::(_processLogs) (41070) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:48:37,230::task::905::Storage.TaskManager.Task::(_runJobs) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7fb75c0a8610>> (args: ('b66bf4f1-94ad-487c-aa76-34598a679d7b', '3656d61b-3977-47c7-9650-f9ba002d07ce', 4194304, 5, 1, 2, '138a98f3-839e-41b0-9c72-0dae737ad838', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:48:37,230::task::331::Storage.TaskManager.Task::(run) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7fb75c0a8610>> (args: ('b66bf4f1-94ad-487c-aa76-34598a679d7b', '3656d61b-3977-47c7-9650-f9ba002d07ce', 4194304, 5, 1, 2, '138a98f3-839e-41b0-9c72-0dae737ad838', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:48:37,230::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`b66bf4f1-94ad-487c-aa76-34598a679d7b_imageNS.3656d61b-3977-47c7-9650-f9ba002d07ce`ReqID=`62de756e-94a3-407c-a495-f80b34dc3e87`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1817' at 'createVolume' >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:48:37,231::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'b66bf4f1-94ad-487c-aa76-34598a679d7b_imageNS.3656d61b-3977-47c7-9650-f9ba002d07ce' for lock type 'exclusive' >Thread-14::DEBUG::2014-09-16 10:48:37,231::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,231::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,231::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,231::__init__::232::IOProcess::(_processLogs) (41071) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:48:37,231::__init__::232::IOProcess::(_processLogs) (41071) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:48:37,232::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 3656d61b-3977-47c7-9650-f9ba002d07ce does not exist in domain b66bf4f1-94ad-487c-aa76-34598a679d7b >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:48:37,232::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'b66bf4f1-94ad-487c-aa76-34598a679d7b_imageNS.3656d61b-3977-47c7-9650-f9ba002d07ce' is free. Now locking as 'exclusive' (1 active user) >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:48:37,232::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`b66bf4f1-94ad-487c-aa76-34598a679d7b_imageNS.3656d61b-3977-47c7-9650-f9ba002d07ce`ReqID=`62de756e-94a3-407c-a495-f80b34dc3e87`::Granted request >7de36444-7941-4cfb-807f-f7bc274736de::INFO::2014-09-16 10:48:37,232::image::121::Storage.Image::(create) Create placeholder /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/b66bf4f1-94ad-487c-aa76-34598a679d7b/images/3656d61b-3977-47c7-9650-f9ba002d07ce for image's volumes >Thread-14::DEBUG::2014-09-16 10:48:37,233::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,233::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,233::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,233::__init__::232::IOProcess::(_processLogs) (41072) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,233::__init__::232::IOProcess::(_processLogs) (41072) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:48:37,233::task::752::Storage.TaskManager.Task::(_save) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::_save: orig /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de temp /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de.temp >Thread-14::DEBUG::2014-09-16 10:48:37,233::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,234::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,234::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,234::__init__::232::IOProcess::(_processLogs) (41073) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,234::__init__::232::IOProcess::(_processLogs) (41073) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,234::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,234::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,234::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,235::__init__::232::IOProcess::(_processLogs) (41074) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,235::__init__::232::IOProcess::(_processLogs) (41074) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,235::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,235::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,235::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,235::__init__::232::IOProcess::(_processLogs) (41075) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:48:37,236::__init__::232::IOProcess::(_processLogs) (41075) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,236::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,236::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,236::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,236::__init__::232::IOProcess::(_processLogs) (41076) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,238::__init__::232::IOProcess::(_processLogs) (41076) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,239::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,239::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,239::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,239::__init__::232::IOProcess::(_processLogs) (41077) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,240::__init__::232::IOProcess::(_processLogs) (41077) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,241::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,241::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,241::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,241::__init__::232::IOProcess::(_processLogs) (41078) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,242::__init__::232::IOProcess::(_processLogs) (41078) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,243::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,243::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,243::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,243::__init__::232::IOProcess::(_processLogs) (41079) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:48:37,243::__init__::232::IOProcess::(_processLogs) (41079) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::WARNING::2014-09-16 10:48:37,244::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:48:37,244::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,244::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,244::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,244::__init__::232::IOProcess::(_processLogs) (41080) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:48:37,245::__init__::232::IOProcess::(_processLogs) (41080) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::WARNING::2014-09-16 10:48:37,245::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:48:37,245::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,246::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,246::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,246::__init__::232::IOProcess::(_processLogs) (41081) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:48:37,247::__init__::232::IOProcess::(_processLogs) (41081) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,247::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,247::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,247::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,247::__init__::232::IOProcess::(_processLogs) (41082) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:48:37,248::__init__::232::IOProcess::(_processLogs) (41082) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,248::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,249::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,249::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,249::__init__::232::IOProcess::(_processLogs) (41083) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:48:37,249::__init__::232::IOProcess::(_processLogs) (41083) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,249::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,250::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,250::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,250::__init__::232::IOProcess::(_processLogs) (41084) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:48:37,250::__init__::232::IOProcess::(_processLogs) (41084) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,251::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,251::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,251::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,251::__init__::232::IOProcess::(_processLogs) (41085) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:48:37,251::__init__::232::IOProcess::(_processLogs) (41085) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,252::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,252::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,252::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,252::__init__::232::IOProcess::(_processLogs) (41086) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:48:37,253::__init__::232::IOProcess::(_processLogs) (41086) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,253::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,253::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,253::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,253::__init__::232::IOProcess::(_processLogs) (41087) Got request for method 'rmdir' >Thread-14::DEBUG::2014-09-16 10:48:37,254::__init__::232::IOProcess::(_processLogs) (41087) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,254::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,254::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,254::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,254::__init__::232::IOProcess::(_processLogs) (41088) Got request for method 'lexists' >Thread-14::DEBUG::2014-09-16 10:48:37,254::__init__::232::IOProcess::(_processLogs) (41088) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::INFO::2014-09-16 10:48:37,255::volume::415::Storage.Volume::(create) Creating volume 138a98f3-839e-41b0-9c72-0dae737ad838 >Thread-14::DEBUG::2014-09-16 10:48:37,256::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,256::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,256::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,256::__init__::232::IOProcess::(_processLogs) (41089) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,256::__init__::232::IOProcess::(_processLogs) (41089) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:48:37,256::task::752::Storage.TaskManager.Task::(_save) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::_save: orig /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de temp /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de.temp >Thread-14::DEBUG::2014-09-16 10:48:37,256::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,257::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,257::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,257::__init__::232::IOProcess::(_processLogs) (41090) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,257::__init__::232::IOProcess::(_processLogs) (41090) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,257::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,258::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,258::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,258::__init__::232::IOProcess::(_processLogs) (41091) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,258::__init__::232::IOProcess::(_processLogs) (41091) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,258::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,258::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,258::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,259::__init__::232::IOProcess::(_processLogs) (41092) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:48:37,259::__init__::232::IOProcess::(_processLogs) (41092) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,259::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,260::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,260::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,260::__init__::232::IOProcess::(_processLogs) (41093) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,261::__init__::232::IOProcess::(_processLogs) (41093) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,262::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,262::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,262::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,262::__init__::232::IOProcess::(_processLogs) (41094) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,264::__init__::232::IOProcess::(_processLogs) (41094) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,264::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,264::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,264::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,264::__init__::232::IOProcess::(_processLogs) (41095) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,266::__init__::232::IOProcess::(_processLogs) (41095) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,266::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,266::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,266::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,267::__init__::232::IOProcess::(_processLogs) (41096) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,268::__init__::232::IOProcess::(_processLogs) (41096) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,268::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,268::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,268::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,269::__init__::232::IOProcess::(_processLogs) (41097) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:48:37,269::__init__::232::IOProcess::(_processLogs) (41097) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::WARNING::2014-09-16 10:48:37,269::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:48:37,269::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,269::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,269::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,269::__init__::232::IOProcess::(_processLogs) (41098) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:48:37,270::__init__::232::IOProcess::(_processLogs) (41098) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::WARNING::2014-09-16 10:48:37,270::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:48:37,271::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,271::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,271::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,271::__init__::232::IOProcess::(_processLogs) (41099) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:48:37,272::__init__::232::IOProcess::(_processLogs) (41099) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,272::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,272::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,272::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,272::__init__::232::IOProcess::(_processLogs) (41100) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:48:37,273::__init__::232::IOProcess::(_processLogs) (41100) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,274::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,274::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,274::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,274::__init__::232::IOProcess::(_processLogs) (41101) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:48:37,274::__init__::232::IOProcess::(_processLogs) (41101) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,274::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,275::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,275::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,275::__init__::232::IOProcess::(_processLogs) (41102) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:48:37,275::__init__::232::IOProcess::(_processLogs) (41102) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,276::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,276::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,276::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,276::__init__::232::IOProcess::(_processLogs) (41103) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:48:37,276::__init__::232::IOProcess::(_processLogs) (41103) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,277::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,277::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,277::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,277::__init__::232::IOProcess::(_processLogs) (41104) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:48:37,277::__init__::232::IOProcess::(_processLogs) (41104) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,278::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,278::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,278::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,278::__init__::232::IOProcess::(_processLogs) (41105) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:48:37,278::__init__::232::IOProcess::(_processLogs) (41105) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,279::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,279::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,279::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,279::__init__::232::IOProcess::(_processLogs) (41106) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:48:37,283::__init__::232::IOProcess::(_processLogs) (41106) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,283::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,283::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,283::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,283::__init__::232::IOProcess::(_processLogs) (41107) Got request for method 'rmdir' >Thread-14::DEBUG::2014-09-16 10:48:37,284::__init__::232::IOProcess::(_processLogs) (41107) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,284::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,284::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,284::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,284::__init__::232::IOProcess::(_processLogs) (41108) Got request for method 'lexists' >Thread-14::DEBUG::2014-09-16 10:48:37,285::__init__::232::IOProcess::(_processLogs) (41108) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,285::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,285::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,285::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,285::__init__::232::IOProcess::(_processLogs) (41109) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,285::__init__::232::IOProcess::(_processLogs) (41109) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:48:37,286::task::752::Storage.TaskManager.Task::(_save) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::_save: orig /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de temp /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de.temp >Thread-14::DEBUG::2014-09-16 10:48:37,286::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,286::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,286::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,286::__init__::232::IOProcess::(_processLogs) (41110) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,286::__init__::232::IOProcess::(_processLogs) (41110) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,287::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,287::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,287::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,287::__init__::232::IOProcess::(_processLogs) (41111) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,287::__init__::232::IOProcess::(_processLogs) (41111) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,287::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,288::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,288::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,288::__init__::232::IOProcess::(_processLogs) (41112) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:48:37,288::__init__::232::IOProcess::(_processLogs) (41112) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,288::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,289::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,289::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,289::__init__::232::IOProcess::(_processLogs) (41113) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,290::__init__::232::IOProcess::(_processLogs) (41113) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,291::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,291::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,291::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,291::__init__::232::IOProcess::(_processLogs) (41114) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,293::__init__::232::IOProcess::(_processLogs) (41114) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,293::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,293::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,293::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,293::__init__::232::IOProcess::(_processLogs) (41115) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,295::__init__::232::IOProcess::(_processLogs) (41115) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,295::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,295::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,295::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,296::__init__::232::IOProcess::(_processLogs) (41116) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,297::__init__::232::IOProcess::(_processLogs) (41116) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,297::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,297::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,297::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,297::__init__::232::IOProcess::(_processLogs) (41117) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:48:37,299::__init__::232::IOProcess::(_processLogs) (41117) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,299::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,299::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,299::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,300::__init__::232::IOProcess::(_processLogs) (41118) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:48:37,300::__init__::232::IOProcess::(_processLogs) (41118) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::WARNING::2014-09-16 10:48:37,300::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:48:37,300::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,300::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,300::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,300::__init__::232::IOProcess::(_processLogs) (41119) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:48:37,301::__init__::232::IOProcess::(_processLogs) (41119) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::WARNING::2014-09-16 10:48:37,301::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:48:37,301::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,302::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,302::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,302::__init__::232::IOProcess::(_processLogs) (41120) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:48:37,303::__init__::232::IOProcess::(_processLogs) (41120) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,303::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,303::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,303::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,303::__init__::232::IOProcess::(_processLogs) (41121) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:48:37,304::__init__::232::IOProcess::(_processLogs) (41121) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,304::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,304::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,305::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,305::__init__::232::IOProcess::(_processLogs) (41122) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:48:37,305::__init__::232::IOProcess::(_processLogs) (41122) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,305::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,305::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,305::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,306::__init__::232::IOProcess::(_processLogs) (41123) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:48:37,306::__init__::232::IOProcess::(_processLogs) (41123) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,306::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,307::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,307::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,307::__init__::232::IOProcess::(_processLogs) (41124) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:48:37,307::__init__::232::IOProcess::(_processLogs) (41124) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,307::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,308::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,308::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,308::__init__::232::IOProcess::(_processLogs) (41125) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:48:37,308::__init__::232::IOProcess::(_processLogs) (41125) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,309::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,309::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,309::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,309::__init__::232::IOProcess::(_processLogs) (41126) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:48:37,309::__init__::232::IOProcess::(_processLogs) (41126) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,310::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,310::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,310::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,310::__init__::232::IOProcess::(_processLogs) (41127) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:48:37,310::__init__::232::IOProcess::(_processLogs) (41127) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,311::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,311::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,311::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,311::__init__::232::IOProcess::(_processLogs) (41128) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:48:37,311::__init__::232::IOProcess::(_processLogs) (41128) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,312::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,312::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,312::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,312::__init__::232::IOProcess::(_processLogs) (41129) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:48:37,313::__init__::232::IOProcess::(_processLogs) (41129) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,313::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,313::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,313::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,313::__init__::232::IOProcess::(_processLogs) (41130) Got request for method 'rmdir' >Thread-14::DEBUG::2014-09-16 10:48:37,314::__init__::232::IOProcess::(_processLogs) (41130) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,314::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,314::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,314::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,314::__init__::232::IOProcess::(_processLogs) (41131) Got request for method 'lexists' >Thread-14::DEBUG::2014-09-16 10:48:37,314::__init__::232::IOProcess::(_processLogs) (41131) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,315::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,315::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,315::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,315::__init__::232::IOProcess::(_processLogs) (41132) Got request for method 'truncate' >Thread-14::DEBUG::2014-09-16 10:48:37,323::__init__::232::IOProcess::(_processLogs) (41132) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,323::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,323::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,323::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,323::__init__::232::IOProcess::(_processLogs) (41133) Got request for method 'chmod' >Thread-14::DEBUG::2014-09-16 10:48:37,324::__init__::232::IOProcess::(_processLogs) (41133) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:48:37,324::utils::778::Storage.Misc.excCmd::(watchCmd) /bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/b66bf4f1-94ad-487c-aa76-34598a679d7b/images/3656d61b-3977-47c7-9650-f9ba002d07ce/138a98f3-839e-41b0-9c72-0dae737ad838 bs=1048576 seek=0 skip=0 conv=notrunc count=2048 oflag=direct (cwd None) >Thread-14::DEBUG::2014-09-16 10:48:37,813::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,814::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,814::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,814::__init__::232::IOProcess::(_processLogs) (41134) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:37,814::__init__::232::IOProcess::(_processLogs) (41134) Queuing response >Thread-47::DEBUG::2014-09-16 10:48:37,814::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:48:37,825::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000306044 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:48:37,825::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,825::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,826::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,826::__init__::232::IOProcess::(_processLogs) (41135) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:37,826::__init__::232::IOProcess::(_processLogs) (41135) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,842::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,842::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,842::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,842::__init__::232::IOProcess::(_processLogs) (41136) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:37,846::__init__::232::IOProcess::(_processLogs) (41136) Queuing response >Thread-21::DEBUG::2014-09-16 10:48:37,847::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:48:37,853::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000364946 s, 1.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:48:37,853::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,853::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,853::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,854::__init__::232::IOProcess::(_processLogs) (41137) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:37,862::__init__::232::IOProcess::(_processLogs) (41137) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,863::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,863::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,863::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,863::__init__::232::IOProcess::(_processLogs) (41138) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,863::__init__::232::IOProcess::(_processLogs) (41138) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,864::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,864::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,864::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,864::__init__::232::IOProcess::(_processLogs) (41139) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,864::__init__::232::IOProcess::(_processLogs) (41139) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:37,865::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:37,865::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:37,865::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:37,865::__init__::232::IOProcess::(_processLogs) (41140) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:37,865::__init__::232::IOProcess::(_processLogs) (41140) Queuing response >Dummy-37::DEBUG::2014-09-16 10:48:38,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:38,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115023 s, 89.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:48:40,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:40,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0204159 s, 50.2 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:48:42,008::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:48:42,008::task::595::Storage.TaskManager.Task::(_updateState) Task=`91c23ecc-5595-49ed-a2c0-4d3a3d347f6d`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:48:42,008::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:48:42,028::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:48:42,028::task::1191::Storage.TaskManager.Task::(prepare) Task=`91c23ecc-5595-49ed-a2c0-4d3a3d347f6d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:48:42,028::task::595::Storage.TaskManager.Task::(_updateState) Task=`91c23ecc-5595-49ed-a2c0-4d3a3d347f6d`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:48:42,029::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:48:42,029::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:48:42,029::task::993::Storage.TaskManager.Task::(_decref) Task=`91c23ecc-5595-49ed-a2c0-4d3a3d347f6d`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:48:42,061::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:48:42,061::task::595::Storage.TaskManager.Task::(_updateState) Task=`13b96521-ed5d-40f2-adaf-2056868c332f`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:48:42,061::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:48:42,062::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`6157ca75-f06f-4d25-a913-33a736b41667`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:48:42,062::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:48:42,062::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:48:42,062::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`6157ca75-f06f-4d25-a913-33a736b41667`::Granted request >Thread-38::DEBUG::2014-09-16 10:48:42,062::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`13b96521-ed5d-40f2-adaf-2056868c332f`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:48:42,062::task::993::Storage.TaskManager.Task::(_decref) Task=`13b96521-ed5d-40f2-adaf-2056868c332f`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:48:42,075::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134618382336', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134614810624', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:48:42,075::task::1191::Storage.TaskManager.Task::(prepare) Task=`13b96521-ed5d-40f2-adaf-2056868c332f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '134618382336', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '134614810624', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:48:42,075::task::595::Storage.TaskManager.Task::(_updateState) Task=`13b96521-ed5d-40f2-adaf-2056868c332f`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:48:42,075::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:48:42,076::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:48:42,076::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:48:42,076::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:48:42,076::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:48:42,076::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:48:42,076::task::993::Storage.TaskManager.Task::(_decref) Task=`13b96521-ed5d-40f2-adaf-2056868c332f`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:48:42,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:42,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114679 s, 89.3 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:48:44,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:44,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178135 s, 57.5 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:48:45,755::task::595::Storage.TaskManager.Task::(_updateState) Task=`24fa9bda-eb12-4683-9e53-5ccfdd3db0de`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:48:45,756::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:48:45,756::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000306044', 'lastCheck': '7.9', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364946', 'lastCheck': '7.9', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:48:45,756::task::1191::Storage.TaskManager.Task::(prepare) Task=`24fa9bda-eb12-4683-9e53-5ccfdd3db0de`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000306044', 'lastCheck': '7.9', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364946', 'lastCheck': '7.9', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:48:45,756::task::595::Storage.TaskManager.Task::(_updateState) Task=`24fa9bda-eb12-4683-9e53-5ccfdd3db0de`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:48:45,756::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:48:45,756::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:48:45,756::task::993::Storage.TaskManager.Task::(_decref) Task=`24fa9bda-eb12-4683-9e53-5ccfdd3db0de`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:48:46,346::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:48:46,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f966eac-ef74-4093-b14e-e2ee752d6ec1`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:48:46,347::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-97::DEBUG::2014-09-16 10:48:46,347::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-97::DEBUG::2014-09-16 10:48:46,347::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 7de36444-7941-4cfb-807f-f7bc274736de >Thread-97::DEBUG::2014-09-16 10:48:46,347::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '7de36444-7941-4cfb-807f-f7bc274736de'} >Thread-97::DEBUG::2014-09-16 10:48:46,347::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'7de36444-7941-4cfb-807f-f7bc274736de': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '7de36444-7941-4cfb-807f-f7bc274736de'}} >Thread-97::INFO::2014-09-16 10:48:46,347::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'7de36444-7941-4cfb-807f-f7bc274736de': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '7de36444-7941-4cfb-807f-f7bc274736de'}}} >Thread-97::DEBUG::2014-09-16 10:48:46,347::task::1191::Storage.TaskManager.Task::(prepare) Task=`5f966eac-ef74-4093-b14e-e2ee752d6ec1`::finished: {'allTasksStatus': {'7de36444-7941-4cfb-807f-f7bc274736de': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '7de36444-7941-4cfb-807f-f7bc274736de'}}} >Thread-97::DEBUG::2014-09-16 10:48:46,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f966eac-ef74-4093-b14e-e2ee752d6ec1`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:48:46,347::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:48:46,347::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:48:46,348::task::993::Storage.TaskManager.Task::(_decref) Task=`5f966eac-ef74-4093-b14e-e2ee752d6ec1`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:48:46,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:46,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118974 s, 86.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:48:47,827::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:47,827::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:47,827::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:47,827::__init__::232::IOProcess::(_processLogs) (41141) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:47,828::__init__::232::IOProcess::(_processLogs) (41141) Queuing response >Thread-47::DEBUG::2014-09-16 10:48:47,829::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:48:47,841::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000310359 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:48:47,842::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:47,842::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:47,842::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:47,842::__init__::232::IOProcess::(_processLogs) (41142) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:47,853::__init__::232::IOProcess::(_processLogs) (41142) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:47,866::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:47,866::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:47,866::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:47,866::__init__::232::IOProcess::(_processLogs) (41143) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:47,866::__init__::232::IOProcess::(_processLogs) (41143) Queuing response >Thread-21::DEBUG::2014-09-16 10:48:47,867::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:48:47,876::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000312336 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:48:47,877::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:47,877::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:47,877::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:47,877::__init__::232::IOProcess::(_processLogs) (41144) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:47,881::__init__::232::IOProcess::(_processLogs) (41144) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:47,881::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:47,882::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:47,882::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:47,882::__init__::232::IOProcess::(_processLogs) (41145) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:47,882::__init__::232::IOProcess::(_processLogs) (41145) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:47,882::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:47,882::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:47,883::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:47,883::__init__::232::IOProcess::(_processLogs) (41146) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:47,883::__init__::232::IOProcess::(_processLogs) (41146) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:47,883::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:47,883::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:47,883::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:47,883::__init__::232::IOProcess::(_processLogs) (41147) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:47,884::__init__::232::IOProcess::(_processLogs) (41147) Queuing response >Dummy-37::DEBUG::2014-09-16 10:48:48,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:48,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114895 s, 89.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:48:50,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:52,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.49313 s, 686 kB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:48:52,385::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:48:52,385::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c205a40-a941-4e55-adba-edad422791c4`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:48:52,385::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:48:52,399::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:48:52,399::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c205a40-a941-4e55-adba-edad422791c4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:48:52,400::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c205a40-a941-4e55-adba-edad422791c4`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:48:52,400::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:48:52,400::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:48:52,400::task::993::Storage.TaskManager.Task::(_decref) Task=`4c205a40-a941-4e55-adba-edad422791c4`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:48:52,433::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:48:52,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`a278f2c0-0d08-4df3-90c3-4e0a7028e5fd`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:48:52,434::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:48:52,434::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`7ff1621b-a889-4b39-9034-dc983d72b1d8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:48:52,434::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:48:52,434::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:48:52,434::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`7ff1621b-a889-4b39-9034-dc983d72b1d8`::Granted request >Thread-38::DEBUG::2014-09-16 10:48:52,435::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a278f2c0-0d08-4df3-90c3-4e0a7028e5fd`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:48:52,435::task::993::Storage.TaskManager.Task::(_decref) Task=`a278f2c0-0d08-4df3-90c3-4e0a7028e5fd`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:48:52,455::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '133953880064', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '133951422464', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:48:52,455::task::1191::Storage.TaskManager.Task::(prepare) Task=`a278f2c0-0d08-4df3-90c3-4e0a7028e5fd`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '133953880064', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '133951422464', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:48:52,455::task::595::Storage.TaskManager.Task::(_updateState) Task=`a278f2c0-0d08-4df3-90c3-4e0a7028e5fd`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:48:52,455::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:48:52,456::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:48:52,456::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:48:52,456::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:48:52,456::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:48:52,456::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:48:52,456::task::993::Storage.TaskManager.Task::(_decref) Task=`a278f2c0-0d08-4df3-90c3-4e0a7028e5fd`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:48:54,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:54,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114909 s, 89.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:48:56,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:56,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115154 s, 88.9 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:48:56,369::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:48:56,369::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c97a50d-a7dd-4798-b3e8-494caebfcff7`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:48:56,369::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-97::DEBUG::2014-09-16 10:48:56,369::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-97::DEBUG::2014-09-16 10:48:56,369::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 7de36444-7941-4cfb-807f-f7bc274736de >Thread-97::DEBUG::2014-09-16 10:48:56,369::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '7de36444-7941-4cfb-807f-f7bc274736de'} >Thread-97::DEBUG::2014-09-16 10:48:56,369::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'7de36444-7941-4cfb-807f-f7bc274736de': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '7de36444-7941-4cfb-807f-f7bc274736de'}} >Thread-97::INFO::2014-09-16 10:48:56,369::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'7de36444-7941-4cfb-807f-f7bc274736de': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '7de36444-7941-4cfb-807f-f7bc274736de'}}} >Thread-97::DEBUG::2014-09-16 10:48:56,370::task::1191::Storage.TaskManager.Task::(prepare) Task=`2c97a50d-a7dd-4798-b3e8-494caebfcff7`::finished: {'allTasksStatus': {'7de36444-7941-4cfb-807f-f7bc274736de': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '7de36444-7941-4cfb-807f-f7bc274736de'}}} >Thread-97::DEBUG::2014-09-16 10:48:56,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c97a50d-a7dd-4798-b3e8-494caebfcff7`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:48:56,370::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:48:56,370::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:48:56,370::task::993::Storage.TaskManager.Task::(_decref) Task=`2c97a50d-a7dd-4798-b3e8-494caebfcff7`::ref 0 aborting False >Thread-14::DEBUG::2014-09-16 10:48:57,854::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:57,854::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:57,854::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:57,855::__init__::232::IOProcess::(_processLogs) (41148) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:57,863::__init__::232::IOProcess::(_processLogs) (41148) Queuing response >Thread-47::DEBUG::2014-09-16 10:48:57,864::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:48:57,874::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.00029959 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:48:57,874::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:57,875::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:57,875::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:57,875::__init__::232::IOProcess::(_processLogs) (41149) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:57,875::__init__::232::IOProcess::(_processLogs) (41149) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:57,884::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:57,884::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:57,885::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:57,885::__init__::232::IOProcess::(_processLogs) (41150) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:57,885::__init__::232::IOProcess::(_processLogs) (41150) Queuing response >Thread-21::DEBUG::2014-09-16 10:48:57,885::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:48:57,895::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000294437 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:48:57,896::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:57,896::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:57,896::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:57,896::__init__::232::IOProcess::(_processLogs) (41151) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:48:57,896::__init__::232::IOProcess::(_processLogs) (41151) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:57,897::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:57,897::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:57,897::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:57,898::__init__::232::IOProcess::(_processLogs) (41152) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:57,898::__init__::232::IOProcess::(_processLogs) (41152) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:57,898::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:57,898::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:57,898::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:57,898::__init__::232::IOProcess::(_processLogs) (41153) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:57,898::__init__::232::IOProcess::(_processLogs) (41153) Queuing response >Thread-14::DEBUG::2014-09-16 10:48:57,899::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:48:57,899::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:48:57,899::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:48:57,899::__init__::232::IOProcess::(_processLogs) (41154) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:48:57,899::__init__::232::IOProcess::(_processLogs) (41154) Queuing response >Dummy-37::DEBUG::2014-09-16 10:48:58,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:48:58,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116344 s, 88.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:49:00,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:00,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116089 s, 88.2 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:49:01,385::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea02fdd3-c2b7-4ac8-a64f-08619c99d40f`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:49:01,385::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:49:01,386::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00029959', 'lastCheck': '3.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294437', 'lastCheck': '3.5', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:49:01,386::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea02fdd3-c2b7-4ac8-a64f-08619c99d40f`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00029959', 'lastCheck': '3.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294437', 'lastCheck': '3.5', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:49:01,386::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea02fdd3-c2b7-4ac8-a64f-08619c99d40f`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:49:01,386::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:49:01,386::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:49:01,386::task::993::Storage.TaskManager.Task::(_decref) Task=`ea02fdd3-c2b7-4ac8-a64f-08619c99d40f`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:49:02,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-97::DEBUG::2014-09-16 10:49:02,639::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:49:02,639::task::595::Storage.TaskManager.Task::(_updateState) Task=`acfb2852-f8bd-41f2-9d7d-3f8f2911612c`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:49:02,640::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:49:02,682::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Dummy-37::DEBUG::2014-09-16 10:49:02,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180925 s, 56.6 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:49:02,683::task::1191::Storage.TaskManager.Task::(prepare) Task=`acfb2852-f8bd-41f2-9d7d-3f8f2911612c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:49:02,684::task::595::Storage.TaskManager.Task::(_updateState) Task=`acfb2852-f8bd-41f2-9d7d-3f8f2911612c`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:49:02,684::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:49:02,685::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:49:02,685::task::993::Storage.TaskManager.Task::(_decref) Task=`acfb2852-f8bd-41f2-9d7d-3f8f2911612c`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:49:02,717::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:49:02,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`b16a05ef-0d4f-49f6-871e-e84c494262b4`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:49:02,717::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:49:02,718::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`238d85fb-b157-41a7-9496-eac29adfcc14`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:49:02,718::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:49:02,718::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:49:02,718::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`238d85fb-b157-41a7-9496-eac29adfcc14`::Granted request >Thread-38::DEBUG::2014-09-16 10:49:02,718::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b16a05ef-0d4f-49f6-871e-e84c494262b4`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:49:02,718::task::993::Storage.TaskManager.Task::(_decref) Task=`b16a05ef-0d4f-49f6-871e-e84c494262b4`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:49:02,739::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '133299666944', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '133297569792', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:49:02,739::task::1191::Storage.TaskManager.Task::(prepare) Task=`b16a05ef-0d4f-49f6-871e-e84c494262b4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '133299666944', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '133297569792', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:49:02,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`b16a05ef-0d4f-49f6-871e-e84c494262b4`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:49:02,739::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:49:02,739::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:49:02,739::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:49:02,740::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:49:02,740::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:49:02,740::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:49:02,740::task::993::Storage.TaskManager.Task::(_decref) Task=`b16a05ef-0d4f-49f6-871e-e84c494262b4`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:49:04,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:04,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115912 s, 88.3 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:49:06,394::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:49:06,394::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ad936ff-d18b-4e8a-be4b-db68e51e7416`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:49:06,395::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-97::DEBUG::2014-09-16 10:49:06,395::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-97::DEBUG::2014-09-16 10:49:06,395::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 7de36444-7941-4cfb-807f-f7bc274736de >Thread-97::DEBUG::2014-09-16 10:49:06,395::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '7de36444-7941-4cfb-807f-f7bc274736de'} >Thread-97::DEBUG::2014-09-16 10:49:06,395::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'7de36444-7941-4cfb-807f-f7bc274736de': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '7de36444-7941-4cfb-807f-f7bc274736de'}} >Thread-97::INFO::2014-09-16 10:49:06,395::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'7de36444-7941-4cfb-807f-f7bc274736de': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '7de36444-7941-4cfb-807f-f7bc274736de'}}} >Thread-97::DEBUG::2014-09-16 10:49:06,395::task::1191::Storage.TaskManager.Task::(prepare) Task=`3ad936ff-d18b-4e8a-be4b-db68e51e7416`::finished: {'allTasksStatus': {'7de36444-7941-4cfb-807f-f7bc274736de': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '7de36444-7941-4cfb-807f-f7bc274736de'}}} >Thread-97::DEBUG::2014-09-16 10:49:06,395::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ad936ff-d18b-4e8a-be4b-db68e51e7416`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:49:06,395::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:49:06,395::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:49:06,396::task::993::Storage.TaskManager.Task::(_decref) Task=`3ad936ff-d18b-4e8a-be4b-db68e51e7416`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:49:06,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:06,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115938 s, 88.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:49:07,876::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:07,876::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:07,876::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:07,876::__init__::232::IOProcess::(_processLogs) (41155) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:07,900::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:07,900::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:07,900::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:07,900::__init__::232::IOProcess::(_processLogs) (41156) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:07,981::__init__::232::IOProcess::(_processLogs) (41156) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:07,981::__init__::232::IOProcess::(_processLogs) (41155) Queuing response >Thread-21::DEBUG::2014-09-16 10:49:07,983::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:49:07,989::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:49:08,019::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000295005 s, 1.5 MB/s\n'; <rc> = 0 >Thread-47::DEBUG::2014-09-16 10:49:08,020::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000362582 s, 896 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:49:08,022::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:08,022::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:08,022::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:08,022::__init__::232::IOProcess::(_processLogs) (41157) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:08,022::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:08,022::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:08,022::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:08,022::__init__::232::IOProcess::(_processLogs) (41158) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:08,030::__init__::232::IOProcess::(_processLogs) (41157) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:08,030::__init__::232::IOProcess::(_processLogs) (41158) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:08,032::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:08,032::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:08,032::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:08,032::__init__::232::IOProcess::(_processLogs) (41159) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:08,032::__init__::232::IOProcess::(_processLogs) (41159) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:08,033::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:08,033::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:08,033::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:08,033::__init__::232::IOProcess::(_processLogs) (41160) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:08,042::__init__::232::IOProcess::(_processLogs) (41160) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:08,042::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:08,042::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:08,042::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:08,043::__init__::232::IOProcess::(_processLogs) (41161) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:08,043::__init__::232::IOProcess::(_processLogs) (41161) Queuing response >Dummy-37::DEBUG::2014-09-16 10:49:08,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:08,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113968 s, 89.8 MB/s\n'; <rc> = 0 >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,613::utils::790::Storage.Misc.excCmd::(watchCmd) SUCCESS: <err> = ['2048+0 records in', '2048+0 records out', '2147483648 bytes (2.1 GB) copied, 32.2827 s, 66.5 MB/s']; <rc> = 0 >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,613::misc::262::Storage.Misc::(validateDDBytes) err: ['2048+0 records in', '2048+0 records out', '2147483648 bytes (2.1 GB) copied, 32.2827 s, 66.5 MB/s'], size: 2147483648 >7de36444-7941-4cfb-807f-f7bc274736de::INFO::2014-09-16 10:49:09,613::fileVolume::133::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/b66bf4f1-94ad-487c-aa76-34598a679d7b/images/3656d61b-3977-47c7-9650-f9ba002d07ce/138a98f3-839e-41b0-9c72-0dae737ad838 with size = 4194304 sectors >Thread-14::DEBUG::2014-09-16 10:49:09,614::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,614::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,614::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,614::__init__::232::IOProcess::(_processLogs) (41162) Got request for method 'chmod' >Thread-14::DEBUG::2014-09-16 10:49:09,615::__init__::232::IOProcess::(_processLogs) (41162) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,615::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,616::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,616::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,616::__init__::232::IOProcess::(_processLogs) (41163) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:09,616::__init__::232::IOProcess::(_processLogs) (41163) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,617::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,617::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,617::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,617::__init__::232::IOProcess::(_processLogs) (41164) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:09,617::__init__::232::IOProcess::(_processLogs) (41164) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,617::task::752::Storage.TaskManager.Task::(_save) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::_save: orig /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de temp /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de.temp >Thread-14::DEBUG::2014-09-16 10:49:09,617::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,618::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,618::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,618::__init__::232::IOProcess::(_processLogs) (41165) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:09,618::__init__::232::IOProcess::(_processLogs) (41165) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,618::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,618::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,619::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,619::__init__::232::IOProcess::(_processLogs) (41166) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:09,619::__init__::232::IOProcess::(_processLogs) (41166) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,619::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,619::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,619::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,619::__init__::232::IOProcess::(_processLogs) (41167) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:49:09,620::__init__::232::IOProcess::(_processLogs) (41167) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,620::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,621::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,621::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,621::__init__::232::IOProcess::(_processLogs) (41168) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:49:09,622::__init__::232::IOProcess::(_processLogs) (41168) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,623::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,623::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,623::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,623::__init__::232::IOProcess::(_processLogs) (41169) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:49:09,625::__init__::232::IOProcess::(_processLogs) (41169) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,625::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,625::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,625::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,626::__init__::232::IOProcess::(_processLogs) (41170) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:49:09,627::__init__::232::IOProcess::(_processLogs) (41170) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,628::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,628::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,628::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,628::__init__::232::IOProcess::(_processLogs) (41171) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:49:09,629::__init__::232::IOProcess::(_processLogs) (41171) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,630::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,630::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,630::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,630::__init__::232::IOProcess::(_processLogs) (41172) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:49:09,632::__init__::232::IOProcess::(_processLogs) (41172) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,632::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,632::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,632::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,633::__init__::232::IOProcess::(_processLogs) (41173) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:49:09,634::__init__::232::IOProcess::(_processLogs) (41173) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,634::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,635::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,635::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,635::__init__::232::IOProcess::(_processLogs) (41174) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:49:09,635::__init__::232::IOProcess::(_processLogs) (41174) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::WARNING::2014-09-16 10:49:09,635::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:49:09,635::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,636::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,636::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,636::__init__::232::IOProcess::(_processLogs) (41175) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:49:09,636::__init__::232::IOProcess::(_processLogs) (41175) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::WARNING::2014-09-16 10:49:09,637::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:49:09,637::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,637::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,637::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,637::__init__::232::IOProcess::(_processLogs) (41176) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:49:09,638::__init__::232::IOProcess::(_processLogs) (41176) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,639::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,639::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,639::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,639::__init__::232::IOProcess::(_processLogs) (41177) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:49:09,640::__init__::232::IOProcess::(_processLogs) (41177) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,640::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,640::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,640::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,640::__init__::232::IOProcess::(_processLogs) (41178) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:09,640::__init__::232::IOProcess::(_processLogs) (41178) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,641::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,641::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,641::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,641::__init__::232::IOProcess::(_processLogs) (41179) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:09,642::__init__::232::IOProcess::(_processLogs) (41179) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,642::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,642::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,642::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,643::__init__::232::IOProcess::(_processLogs) (41180) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:09,643::__init__::232::IOProcess::(_processLogs) (41180) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,643::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,643::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,644::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,644::__init__::232::IOProcess::(_processLogs) (41181) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:09,644::__init__::232::IOProcess::(_processLogs) (41181) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,645::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,645::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,645::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,645::__init__::232::IOProcess::(_processLogs) (41182) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:09,645::__init__::232::IOProcess::(_processLogs) (41182) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,646::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,646::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,646::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,646::__init__::232::IOProcess::(_processLogs) (41183) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:09,646::__init__::232::IOProcess::(_processLogs) (41183) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,647::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,647::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,647::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,647::__init__::232::IOProcess::(_processLogs) (41184) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:09,647::__init__::232::IOProcess::(_processLogs) (41184) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,648::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,648::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,648::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,648::__init__::232::IOProcess::(_processLogs) (41185) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:09,649::__init__::232::IOProcess::(_processLogs) (41185) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,649::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,649::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,649::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,649::__init__::232::IOProcess::(_processLogs) (41186) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:09,650::__init__::232::IOProcess::(_processLogs) (41186) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,650::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,650::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,650::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,650::__init__::232::IOProcess::(_processLogs) (41187) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:09,651::__init__::232::IOProcess::(_processLogs) (41187) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,652::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,652::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,652::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,652::__init__::232::IOProcess::(_processLogs) (41188) Got request for method 'rmdir' >Thread-14::DEBUG::2014-09-16 10:49:09,652::__init__::232::IOProcess::(_processLogs) (41188) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,653::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,653::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,653::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,653::__init__::232::IOProcess::(_processLogs) (41189) Got request for method 'lexists' >Thread-14::DEBUG::2014-09-16 10:49:09,653::__init__::232::IOProcess::(_processLogs) (41189) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::WARNING::2014-09-16 10:49:09,655::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:49:09,655::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,655::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,655::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,655::__init__::232::IOProcess::(_processLogs) (41190) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:49:09,656::__init__::232::IOProcess::(_processLogs) (41190) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,656::fileVolume::384::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=138a98f3-839e-41b0-9c72-0dae737ad838 sdUUID=b66bf4f1-94ad-487c-aa76-34598a679d7b, metaId=(u'/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/b66bf4f1-94ad-487c-aa76-34598a679d7b/images/3656d61b-3977-47c7-9650-f9ba002d07ce/138a98f3-839e-41b0-9c72-0dae737ad838',) >Thread-14::DEBUG::2014-09-16 10:49:09,657::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,657::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,657::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,657::__init__::232::IOProcess::(_processLogs) (41191) Got request for method 'truncate' >Thread-14::DEBUG::2014-09-16 10:49:09,658::__init__::232::IOProcess::(_processLogs) (41191) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,659::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,659::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,659::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,659::__init__::232::IOProcess::(_processLogs) (41192) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:09,659::__init__::232::IOProcess::(_processLogs) (41192) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,660::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,660::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,660::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,660::__init__::232::IOProcess::(_processLogs) (41193) Got request for method 'chmod' >Thread-14::DEBUG::2014-09-16 10:49:09,660::__init__::232::IOProcess::(_processLogs) (41193) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,677::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,677::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,677::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,677::__init__::232::IOProcess::(_processLogs) (41194) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:09,677::__init__::232::IOProcess::(_processLogs) (41194) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,677::task::752::Storage.TaskManager.Task::(_save) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::_save: orig /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de temp /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de.temp >Thread-14::DEBUG::2014-09-16 10:49:09,677::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,678::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,678::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,678::__init__::232::IOProcess::(_processLogs) (41195) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:09,678::__init__::232::IOProcess::(_processLogs) (41195) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,678::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,678::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,678::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,679::__init__::232::IOProcess::(_processLogs) (41196) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:09,679::__init__::232::IOProcess::(_processLogs) (41196) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,679::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,679::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,679::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,679::__init__::232::IOProcess::(_processLogs) (41197) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:49:09,680::__init__::232::IOProcess::(_processLogs) (41197) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,680::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,680::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,680::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,680::__init__::232::IOProcess::(_processLogs) (41198) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:49:09,682::__init__::232::IOProcess::(_processLogs) (41198) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,682::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,683::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,683::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,683::__init__::232::IOProcess::(_processLogs) (41199) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:49:09,684::__init__::232::IOProcess::(_processLogs) (41199) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,685::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,685::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,685::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,685::__init__::232::IOProcess::(_processLogs) (41200) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:49:09,686::__init__::232::IOProcess::(_processLogs) (41200) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,687::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,687::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,687::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,687::__init__::232::IOProcess::(_processLogs) (41201) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:49:09,688::__init__::232::IOProcess::(_processLogs) (41201) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,689::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,689::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,689::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,689::__init__::232::IOProcess::(_processLogs) (41202) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:49:09,689::__init__::232::IOProcess::(_processLogs) (41202) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::WARNING::2014-09-16 10:49:09,689::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:49:09,690::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,690::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,690::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,690::__init__::232::IOProcess::(_processLogs) (41203) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:49:09,690::__init__::232::IOProcess::(_processLogs) (41203) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::WARNING::2014-09-16 10:49:09,691::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:49:09,691::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,691::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,691::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,691::__init__::232::IOProcess::(_processLogs) (41204) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:49:09,692::__init__::232::IOProcess::(_processLogs) (41204) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,692::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,693::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,693::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,693::__init__::232::IOProcess::(_processLogs) (41205) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:49:09,693::__init__::232::IOProcess::(_processLogs) (41205) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,694::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,694::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,694::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,694::__init__::232::IOProcess::(_processLogs) (41206) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:09,694::__init__::232::IOProcess::(_processLogs) (41206) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,695::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,695::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,695::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,695::__init__::232::IOProcess::(_processLogs) (41207) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:09,696::__init__::232::IOProcess::(_processLogs) (41207) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,696::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,696::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,696::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,696::__init__::232::IOProcess::(_processLogs) (41208) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:09,696::__init__::232::IOProcess::(_processLogs) (41208) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,697::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,697::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,697::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,697::__init__::232::IOProcess::(_processLogs) (41209) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:09,698::__init__::232::IOProcess::(_processLogs) (41209) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,698::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,698::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,698::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,698::__init__::232::IOProcess::(_processLogs) (41210) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:09,698::__init__::232::IOProcess::(_processLogs) (41210) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,699::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,699::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,699::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,699::__init__::232::IOProcess::(_processLogs) (41211) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:09,700::__init__::232::IOProcess::(_processLogs) (41211) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,700::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,700::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,700::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,701::__init__::232::IOProcess::(_processLogs) (41212) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:09,701::__init__::232::IOProcess::(_processLogs) (41212) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,701::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,701::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,701::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,701::__init__::232::IOProcess::(_processLogs) (41213) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:09,702::__init__::232::IOProcess::(_processLogs) (41213) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,702::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,702::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,702::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,703::__init__::232::IOProcess::(_processLogs) (41214) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:09,703::__init__::232::IOProcess::(_processLogs) (41214) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,703::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,703::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,703::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,704::__init__::232::IOProcess::(_processLogs) (41215) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:09,704::__init__::232::IOProcess::(_processLogs) (41215) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,704::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,704::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,705::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,705::__init__::232::IOProcess::(_processLogs) (41216) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:09,705::__init__::232::IOProcess::(_processLogs) (41216) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,705::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,706::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,706::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,706::__init__::232::IOProcess::(_processLogs) (41217) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:09,706::__init__::232::IOProcess::(_processLogs) (41217) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,706::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,707::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,707::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,707::__init__::232::IOProcess::(_processLogs) (41218) Got request for method 'rmdir' >Thread-14::DEBUG::2014-09-16 10:49:09,707::__init__::232::IOProcess::(_processLogs) (41218) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,707::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,708::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,708::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,708::__init__::232::IOProcess::(_processLogs) (41219) Got request for method 'lexists' >Thread-14::DEBUG::2014-09-16 10:49:09,708::__init__::232::IOProcess::(_processLogs) (41219) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,708::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'b66bf4f1-94ad-487c-aa76-34598a679d7b_imageNS.3656d61b-3977-47c7-9650-f9ba002d07ce' >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,708::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'b66bf4f1-94ad-487c-aa76-34598a679d7b_imageNS.3656d61b-3977-47c7-9650-f9ba002d07ce' (0 active users) >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,708::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'b66bf4f1-94ad-487c-aa76-34598a679d7b_imageNS.3656d61b-3977-47c7-9650-f9ba002d07ce' is free, finding out if anyone is waiting for it. >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,709::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'b66bf4f1-94ad-487c-aa76-34598a679d7b_imageNS.3656d61b-3977-47c7-9650-f9ba002d07ce', Clearing records. >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,709::task::595::Storage.TaskManager.Task::(_updateState) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::moving from state running -> state finished >Thread-14::DEBUG::2014-09-16 10:49:09,709::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,709::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,709::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,709::__init__::232::IOProcess::(_processLogs) (41220) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:09,709::__init__::232::IOProcess::(_processLogs) (41220) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,710::task::752::Storage.TaskManager.Task::(_save) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::_save: orig /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de temp /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/master/tasks/7de36444-7941-4cfb-807f-f7bc274736de.temp >Thread-14::DEBUG::2014-09-16 10:49:09,710::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,710::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,710::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,710::__init__::232::IOProcess::(_processLogs) (41221) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:09,710::__init__::232::IOProcess::(_processLogs) (41221) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,711::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,711::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,711::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,711::__init__::232::IOProcess::(_processLogs) (41222) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:09,711::__init__::232::IOProcess::(_processLogs) (41222) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,711::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,711::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,712::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,712::__init__::232::IOProcess::(_processLogs) (41223) Got request for method 'mkdir' >Thread-14::DEBUG::2014-09-16 10:49:09,712::__init__::232::IOProcess::(_processLogs) (41223) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,712::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,713::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,713::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,713::__init__::232::IOProcess::(_processLogs) (41224) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:49:09,714::__init__::232::IOProcess::(_processLogs) (41224) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,715::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,715::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,715::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,715::__init__::232::IOProcess::(_processLogs) (41225) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:49:09,716::__init__::232::IOProcess::(_processLogs) (41225) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,717::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,717::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,717::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,717::__init__::232::IOProcess::(_processLogs) (41226) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:49:09,718::__init__::232::IOProcess::(_processLogs) (41226) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,719::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,719::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,719::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,719::__init__::232::IOProcess::(_processLogs) (41227) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:49:09,721::__init__::232::IOProcess::(_processLogs) (41227) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,721::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,721::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,721::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,721::__init__::232::IOProcess::(_processLogs) (41228) Got request for method 'writefile' >Thread-14::DEBUG::2014-09-16 10:49:09,723::__init__::232::IOProcess::(_processLogs) (41228) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,723::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,723::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,723::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,723::__init__::232::IOProcess::(_processLogs) (41229) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:49:09,723::__init__::232::IOProcess::(_processLogs) (41229) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::WARNING::2014-09-16 10:49:09,724::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:49:09,724::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,724::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,724::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,724::__init__::232::IOProcess::(_processLogs) (41230) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:49:09,725::__init__::232::IOProcess::(_processLogs) (41230) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::WARNING::2014-09-16 10:49:09,725::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-14::DEBUG::2014-09-16 10:49:09,725::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,725::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,725::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,726::__init__::232::IOProcess::(_processLogs) (41231) Got request for method 'rename' >Thread-14::DEBUG::2014-09-16 10:49:09,726::__init__::232::IOProcess::(_processLogs) (41231) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,727::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,727::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,727::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,727::__init__::232::IOProcess::(_processLogs) (41232) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:49:09,728::__init__::232::IOProcess::(_processLogs) (41232) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,728::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,728::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,728::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,728::__init__::232::IOProcess::(_processLogs) (41233) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:09,729::__init__::232::IOProcess::(_processLogs) (41233) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,729::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,729::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,729::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,729::__init__::232::IOProcess::(_processLogs) (41234) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:09,730::__init__::232::IOProcess::(_processLogs) (41234) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,730::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,730::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,730::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,731::__init__::232::IOProcess::(_processLogs) (41235) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:09,731::__init__::232::IOProcess::(_processLogs) (41235) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,731::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,731::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,731::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,732::__init__::232::IOProcess::(_processLogs) (41236) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:09,733::__init__::232::IOProcess::(_processLogs) (41236) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,733::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,733::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,733::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,733::__init__::232::IOProcess::(_processLogs) (41237) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:09,733::__init__::232::IOProcess::(_processLogs) (41237) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,734::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,734::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,734::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,734::__init__::232::IOProcess::(_processLogs) (41238) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:09,735::__init__::232::IOProcess::(_processLogs) (41238) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,735::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,735::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,735::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,735::__init__::232::IOProcess::(_processLogs) (41239) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:09,735::__init__::232::IOProcess::(_processLogs) (41239) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,736::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,736::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,736::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,736::__init__::232::IOProcess::(_processLogs) (41240) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:09,737::__init__::232::IOProcess::(_processLogs) (41240) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,737::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,737::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,737::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,737::__init__::232::IOProcess::(_processLogs) (41241) Got request for method 'rmdir' >Thread-14::DEBUG::2014-09-16 10:49:09,738::__init__::232::IOProcess::(_processLogs) (41241) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:09,738::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:09,738::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:09,738::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:09,738::__init__::232::IOProcess::(_processLogs) (41242) Got request for method 'lexists' >Thread-14::DEBUG::2014-09-16 10:49:09,739::__init__::232::IOProcess::(_processLogs) (41242) Queuing response >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,739::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b': < ResourceRef 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b', isValid: 'True' obj: 'None'>} >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,739::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,739::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b' >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,739::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b' (0 active users) >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,739::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b' is free, finding out if anyone is waiting for it. >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,739::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b', Clearing records. >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,739::task::916::Storage.TaskManager.Task::(_runJobs) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::Task.run: exit - success: result {'uuid': '138a98f3-839e-41b0-9c72-0dae737ad838'} >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,740::task::993::Storage.TaskManager.Task::(_decref) Task=`7de36444-7941-4cfb-807f-f7bc274736de`::ref 0 aborting False >7de36444-7941-4cfb-807f-f7bc274736de::DEBUG::2014-09-16 10:49:09,740::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-37::DEBUG::2014-09-16 10:49:10,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:10,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114233 s, 89.6 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:49:12,816::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:49:12,817::task::595::Storage.TaskManager.Task::(_updateState) Task=`73bb1c3a-496a-4320-9704-40f015aa3ac0`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:49:12,817::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:49:12,899::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:49:12,899::task::1191::Storage.TaskManager.Task::(prepare) Task=`73bb1c3a-496a-4320-9704-40f015aa3ac0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:49:12,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`73bb1c3a-496a-4320-9704-40f015aa3ac0`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:49:12,900::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:49:12,900::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:49:12,900::task::993::Storage.TaskManager.Task::(_decref) Task=`73bb1c3a-496a-4320-9704-40f015aa3ac0`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:49:12,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:12,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113472 s, 90.2 MB/s\n'; <rc> = 0 >Thread-38::DEBUG::2014-09-16 10:49:12,951::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:49:12,952::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d46b8ab-8dbb-4ecc-b3bc-4c94638c5726`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:49:12,952::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:49:12,953::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`a3db70c4-5292-4857-be4a-8d5dd08ef0eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:49:12,954::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:49:12,954::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:49:12,955::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`a3db70c4-5292-4857-be4a-8d5dd08ef0eb`::Granted request >Thread-38::DEBUG::2014-09-16 10:49:12,956::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3d46b8ab-8dbb-4ecc-b3bc-4c94638c5726`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:49:12,956::task::993::Storage.TaskManager.Task::(_decref) Task=`3d46b8ab-8dbb-4ecc-b3bc-4c94638c5726`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:49:12,972::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132602658816', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132602658816', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:49:12,972::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d46b8ab-8dbb-4ecc-b3bc-4c94638c5726`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132602658816', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132602658816', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:49:12,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d46b8ab-8dbb-4ecc-b3bc-4c94638c5726`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:49:12,972::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:49:12,972::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:49:12,972::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:49:12,972::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:49:12,972::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:49:12,973::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:49:12,973::task::993::Storage.TaskManager.Task::(_decref) Task=`3d46b8ab-8dbb-4ecc-b3bc-4c94638c5726`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:49:14,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:15,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170544 s, 60.0 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:49:16,418::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:49:16,418::task::595::Storage.TaskManager.Task::(_updateState) Task=`105ade12-43b8-49c9-a13e-f94d813c4ef0`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:49:16,418::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-97::DEBUG::2014-09-16 10:49:16,418::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-97::DEBUG::2014-09-16 10:49:16,418::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 7de36444-7941-4cfb-807f-f7bc274736de >Thread-97::DEBUG::2014-09-16 10:49:16,418::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7de36444-7941-4cfb-807f-f7bc274736de'} >Thread-97::DEBUG::2014-09-16 10:49:16,419::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'7de36444-7941-4cfb-807f-f7bc274736de': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7de36444-7941-4cfb-807f-f7bc274736de'}} >Thread-97::INFO::2014-09-16 10:49:16,419::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'7de36444-7941-4cfb-807f-f7bc274736de': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7de36444-7941-4cfb-807f-f7bc274736de'}}} >Thread-97::DEBUG::2014-09-16 10:49:16,419::task::1191::Storage.TaskManager.Task::(prepare) Task=`105ade12-43b8-49c9-a13e-f94d813c4ef0`::finished: {'allTasksStatus': {'7de36444-7941-4cfb-807f-f7bc274736de': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7de36444-7941-4cfb-807f-f7bc274736de'}}} >Thread-97::DEBUG::2014-09-16 10:49:16,419::task::595::Storage.TaskManager.Task::(_updateState) Task=`105ade12-43b8-49c9-a13e-f94d813c4ef0`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:49:16,419::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:49:16,419::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:49:16,419::task::993::Storage.TaskManager.Task::(_decref) Task=`105ade12-43b8-49c9-a13e-f94d813c4ef0`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:49:17,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:17,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115294 s, 88.8 MB/s\n'; <rc> = 0 >Thread-38::DEBUG::2014-09-16 10:49:17,066::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] flowID [4a2a61c3] >Thread-38::DEBUG::2014-09-16 10:49:17,067::task::595::Storage.TaskManager.Task::(_updateState) Task=`a47d4168-ef99-412b-a1e4-b1a97a4cbc0e`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:49:17,068::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='b66bf4f1-94ad-487c-aa76-34598a679d7b', spUUID='da06caa7-b08d-4685-b49c-84565c268648', imgUUID='3656d61b-3977-47c7-9650-f9ba002d07ce', volUUID='138a98f3-839e-41b0-9c72-0dae737ad838', options=None) >Thread-38::DEBUG::2014-09-16 10:49:17,069::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b`ReqID=`7434e7fb-1995-4912-bfd1-a5d0e6751813`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3133' at 'getVolumeInfo' >Thread-38::DEBUG::2014-09-16 10:49:17,070::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:49:17,070::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:49:17,071::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b`ReqID=`7434e7fb-1995-4912-bfd1-a5d0e6751813`::Granted request >Thread-38::DEBUG::2014-09-16 10:49:17,072::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a47d4168-ef99-412b-a1e4-b1a97a4cbc0e`::_resourcesAcquired: Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b (shared) >Thread-38::DEBUG::2014-09-16 10:49:17,072::task::993::Storage.TaskManager.Task::(_decref) Task=`a47d4168-ef99-412b-a1e4-b1a97a4cbc0e`::ref 1 aborting False >Thread-14::DEBUG::2014-09-16 10:49:17,073::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,074::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,075::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,075::__init__::232::IOProcess::(_processLogs) (41243) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:17,076::__init__::232::IOProcess::(_processLogs) (41243) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:17,079::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,080::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,081::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,081::__init__::232::IOProcess::(_processLogs) (41244) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:17,082::__init__::232::IOProcess::(_processLogs) (41244) Queuing response >Thread-38::DEBUG::2014-09-16 10:49:17,083::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 138a98f3-839e-41b0-9c72-0dae737ad838 >Thread-14::DEBUG::2014-09-16 10:49:17,084::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,085::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,086::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,086::__init__::232::IOProcess::(_processLogs) (41245) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:17,087::__init__::232::IOProcess::(_processLogs) (41245) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:17,089::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,090::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,091::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,091::__init__::232::IOProcess::(_processLogs) (41246) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:17,092::__init__::232::IOProcess::(_processLogs) (41246) Queuing response >Thread-38::INFO::2014-09-16 10:49:17,094::volume::848::Storage.Volume::(getInfo) Info request: sdUUID=b66bf4f1-94ad-487c-aa76-34598a679d7b imgUUID=3656d61b-3977-47c7-9650-f9ba002d07ce volUUID = 138a98f3-839e-41b0-9c72-0dae737ad838 >Thread-14::DEBUG::2014-09-16 10:49:17,095::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,095::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,096::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,097::__init__::232::IOProcess::(_processLogs) (41247) Got request for method 'readfile' >Thread-14::DEBUG::2014-09-16 10:49:17,097::__init__::232::IOProcess::(_processLogs) (41247) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:17,100::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,100::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,101::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,102::__init__::232::IOProcess::(_processLogs) (41248) Got request for method 'readfile' >Thread-14::DEBUG::2014-09-16 10:49:17,102::__init__::232::IOProcess::(_processLogs) (41248) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:17,105::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,105::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,106::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,106::__init__::232::IOProcess::(_processLogs) (41249) Got request for method 'readfile' >Thread-14::DEBUG::2014-09-16 10:49:17,107::__init__::232::IOProcess::(_processLogs) (41249) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:17,109::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,110::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,111::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,111::__init__::232::IOProcess::(_processLogs) (41250) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:17,112::__init__::232::IOProcess::(_processLogs) (41250) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:17,115::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,116::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,116::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,117::__init__::232::IOProcess::(_processLogs) (41251) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:17,117::__init__::232::IOProcess::(_processLogs) (41251) Queuing response >Thread-38::INFO::2014-09-16 10:49:17,120::volume::876::Storage.Volume::(getInfo) b66bf4f1-94ad-487c-aa76-34598a679d7b/3656d61b-3977-47c7-9650-f9ba002d07ce/138a98f3-839e-41b0-9c72-0dae737ad838 info is {'status': 'OK', 'domain': 'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': '3656d61b-3977-47c7-9650-f9ba002d07ce', 'ctime': '1410857349', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '2147483648', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '138a98f3-839e-41b0-9c72-0dae737ad838', 'truesize': '2148540416', 'type': 'PREALLOCATED'} >Thread-38::INFO::2014-09-16 10:49:17,120::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': '3656d61b-3977-47c7-9650-f9ba002d07ce', 'ctime': '1410857349', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '2147483648', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '138a98f3-839e-41b0-9c72-0dae737ad838', 'truesize': '2148540416', 'type': 'PREALLOCATED'}} >Thread-38::DEBUG::2014-09-16 10:49:17,122::task::1191::Storage.TaskManager.Task::(prepare) Task=`a47d4168-ef99-412b-a1e4-b1a97a4cbc0e`::finished: {'info': {'status': 'OK', 'domain': 'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': '3656d61b-3977-47c7-9650-f9ba002d07ce', 'ctime': '1410857349', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '2147483648', 'children': [], 'pool': '', 'capacity': '2147483648', 'uuid': '138a98f3-839e-41b0-9c72-0dae737ad838', 'truesize': '2148540416', 'type': 'PREALLOCATED'}} >Thread-38::DEBUG::2014-09-16 10:49:17,122::task::595::Storage.TaskManager.Task::(_updateState) Task=`a47d4168-ef99-412b-a1e4-b1a97a4cbc0e`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:49:17,123::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b': < ResourceRef 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:49:17,124::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:49:17,126::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b' >Thread-97::DEBUG::2014-09-16 10:49:17,127::task::595::Storage.TaskManager.Task::(_updateState) Task=`90c23409-b03b-4b2f-8263-5021c42d26a5`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:49:17,128::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-38::DEBUG::2014-09-16 10:49:17,128::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b' (0 active users) >Thread-38::DEBUG::2014-09-16 10:49:17,129::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b' is free, finding out if anyone is waiting for it. >Thread-97::INFO::2014-09-16 10:49:17,130::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000362582', 'lastCheck': '9.1', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000295005', 'lastCheck': '9.1', 'valid': True}} >Thread-38::DEBUG::2014-09-16 10:49:17,130::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b', Clearing records. >Thread-97::DEBUG::2014-09-16 10:49:17,131::task::1191::Storage.TaskManager.Task::(prepare) Task=`90c23409-b03b-4b2f-8263-5021c42d26a5`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000362582', 'lastCheck': '9.1', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000295005', 'lastCheck': '9.1', 'valid': True}} >Thread-38::DEBUG::2014-09-16 10:49:17,132::task::993::Storage.TaskManager.Task::(_decref) Task=`a47d4168-ef99-412b-a1e4-b1a97a4cbc0e`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:49:17,132::task::595::Storage.TaskManager.Task::(_updateState) Task=`90c23409-b03b-4b2f-8263-5021c42d26a5`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:49:17,133::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:49:17,134::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:49:17,135::task::993::Storage.TaskManager.Task::(_decref) Task=`90c23409-b03b-4b2f-8263-5021c42d26a5`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:49:17,611::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:49:17,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`dec02a50-d304-4f50-9c2f-1533d7cfe209`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:49:17,612::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='7de36444-7941-4cfb-807f-f7bc274736de', spUUID=None, options=None) >Thread-97::DEBUG::2014-09-16 10:49:17,612::taskManager::171::Storage.TaskManager::(clearTask) Entry. taskID: 7de36444-7941-4cfb-807f-f7bc274736de >Thread-14::DEBUG::2014-09-16 10:49:17,613::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,613::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,613::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,613::__init__::232::IOProcess::(_processLogs) (41252) Got request for method 'listdir' >Thread-14::DEBUG::2014-09-16 10:49:17,614::__init__::232::IOProcess::(_processLogs) (41252) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:17,614::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,615::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,615::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,615::__init__::232::IOProcess::(_processLogs) (41253) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:17,615::__init__::232::IOProcess::(_processLogs) (41253) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:17,615::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,616::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,616::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,616::__init__::232::IOProcess::(_processLogs) (41254) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:17,616::__init__::232::IOProcess::(_processLogs) (41254) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:17,617::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,617::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,617::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,617::__init__::232::IOProcess::(_processLogs) (41255) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:17,617::__init__::232::IOProcess::(_processLogs) (41255) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:17,618::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,618::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,618::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,618::__init__::232::IOProcess::(_processLogs) (41256) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:17,619::__init__::232::IOProcess::(_processLogs) (41256) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:17,619::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,619::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,619::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,620::__init__::232::IOProcess::(_processLogs) (41257) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:17,620::__init__::232::IOProcess::(_processLogs) (41257) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:17,620::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,621::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,621::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,621::__init__::232::IOProcess::(_processLogs) (41258) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:17,621::__init__::232::IOProcess::(_processLogs) (41258) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:17,622::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,622::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,622::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,622::__init__::232::IOProcess::(_processLogs) (41259) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:17,622::__init__::232::IOProcess::(_processLogs) (41259) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:17,623::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,623::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,623::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,623::__init__::232::IOProcess::(_processLogs) (41260) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:17,624::__init__::232::IOProcess::(_processLogs) (41260) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:17,624::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,624::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,624::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,624::__init__::232::IOProcess::(_processLogs) (41261) Got request for method 'stat' >Thread-14::DEBUG::2014-09-16 10:49:17,625::__init__::232::IOProcess::(_processLogs) (41261) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:17,625::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,625::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,626::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,626::__init__::232::IOProcess::(_processLogs) (41262) Got request for method 'unlink' >Thread-14::DEBUG::2014-09-16 10:49:17,626::__init__::232::IOProcess::(_processLogs) (41262) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:17,626::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:17,627::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:17,627::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:17,627::__init__::232::IOProcess::(_processLogs) (41263) Got request for method 'rmdir' >Thread-14::DEBUG::2014-09-16 10:49:17,627::__init__::232::IOProcess::(_processLogs) (41263) Queuing response >Thread-97::DEBUG::2014-09-16 10:49:17,627::taskManager::176::Storage.TaskManager::(clearTask) Return. >Thread-97::INFO::2014-09-16 10:49:17,627::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-97::DEBUG::2014-09-16 10:49:17,628::task::1191::Storage.TaskManager.Task::(prepare) Task=`dec02a50-d304-4f50-9c2f-1533d7cfe209`::finished: None >Thread-97::DEBUG::2014-09-16 10:49:17,628::task::595::Storage.TaskManager.Task::(_updateState) Task=`dec02a50-d304-4f50-9c2f-1533d7cfe209`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:49:17,628::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:49:17,628::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:49:17,628::task::993::Storage.TaskManager.Task::(_decref) Task=`dec02a50-d304-4f50-9c2f-1533d7cfe209`::ref 0 aborting False >Thread-14::DEBUG::2014-09-16 10:49:18,032::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:18,033::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:18,033::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:18,033::__init__::232::IOProcess::(_processLogs) (41264) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:18,033::__init__::232::IOProcess::(_processLogs) (41264) Queuing response >Thread-47::DEBUG::2014-09-16 10:49:18,033::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:49:18,039::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000341392 s, 952 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:49:18,040::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:18,040::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:18,040::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:18,040::__init__::232::IOProcess::(_processLogs) (41265) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:18,040::__init__::232::IOProcess::(_processLogs) (41265) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:18,043::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:18,044::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:18,044::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:18,044::__init__::232::IOProcess::(_processLogs) (41266) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:18,044::__init__::232::IOProcess::(_processLogs) (41266) Queuing response >Thread-21::DEBUG::2014-09-16 10:49:18,044::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:49:18,050::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000307317 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:49:18,050::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:18,050::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:18,051::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:18,051::__init__::232::IOProcess::(_processLogs) (41267) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:18,051::__init__::232::IOProcess::(_processLogs) (41267) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:18,052::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:18,052::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:18,052::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:18,052::__init__::232::IOProcess::(_processLogs) (41268) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:18,052::__init__::232::IOProcess::(_processLogs) (41268) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:18,052::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:18,052::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:18,053::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:18,053::__init__::232::IOProcess::(_processLogs) (41269) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:18,053::__init__::232::IOProcess::(_processLogs) (41269) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:18,053::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:18,053::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:18,053::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:18,053::__init__::232::IOProcess::(_processLogs) (41270) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:18,054::__init__::232::IOProcess::(_processLogs) (41270) Queuing response >Dummy-37::DEBUG::2014-09-16 10:49:19,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:19,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117244 s, 87.3 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:49:21,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:21,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113781 s, 90.0 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:49:23,096::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:49:23,096::task::595::Storage.TaskManager.Task::(_updateState) Task=`217bc66c-7784-4894-9ee9-c77ff4dc46af`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:49:23,096::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:49:23,108::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:49:23,108::task::1191::Storage.TaskManager.Task::(prepare) Task=`217bc66c-7784-4894-9ee9-c77ff4dc46af`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:49:23,108::task::595::Storage.TaskManager.Task::(_updateState) Task=`217bc66c-7784-4894-9ee9-c77ff4dc46af`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:49:23,108::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:49:23,108::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:49:23,108::task::993::Storage.TaskManager.Task::(_decref) Task=`217bc66c-7784-4894-9ee9-c77ff4dc46af`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:49:23,148::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:49:23,148::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe29af67-18e0-4d62-b0c4-f4dab7b6e9b0`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:49:23,148::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:49:23,149::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`6f99fe3d-9caf-441d-9e6f-2c7f19a54e63`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:49:23,149::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:49:23,149::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:49:23,149::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`6f99fe3d-9caf-441d-9e6f-2c7f19a54e63`::Granted request >Thread-38::DEBUG::2014-09-16 10:49:23,149::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fe29af67-18e0-4d62-b0c4-f4dab7b6e9b0`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:49:23,149::task::993::Storage.TaskManager.Task::(_decref) Task=`fe29af67-18e0-4d62-b0c4-f4dab7b6e9b0`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:49:23,161::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:49:23,161::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe29af67-18e0-4d62-b0c4-f4dab7b6e9b0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:49:23,161::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe29af67-18e0-4d62-b0c4-f4dab7b6e9b0`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:49:23,161::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:49:23,162::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:49:23,162::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:49:23,162::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:49:23,162::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:49:23,162::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:49:23,162::task::993::Storage.TaskManager.Task::(_decref) Task=`fe29af67-18e0-4d62-b0c4-f4dab7b6e9b0`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:49:23,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:23,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112836 s, 90.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:49:25,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:25,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115285 s, 88.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:49:27,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:27,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124763 s, 82.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:49:28,041::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:28,041::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:28,041::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:28,042::__init__::232::IOProcess::(_processLogs) (41271) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:28,042::__init__::232::IOProcess::(_processLogs) (41271) Queuing response >Thread-47::DEBUG::2014-09-16 10:49:28,042::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:49:28,048::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000324774 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:49:28,049::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:28,049::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:28,049::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:28,049::__init__::232::IOProcess::(_processLogs) (41272) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:28,049::__init__::232::IOProcess::(_processLogs) (41272) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:28,054::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:28,055::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:28,055::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:28,055::__init__::232::IOProcess::(_processLogs) (41273) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:28,055::__init__::232::IOProcess::(_processLogs) (41273) Queuing response >Thread-21::DEBUG::2014-09-16 10:49:28,055::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:49:28,061::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.00036524 s, 1.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:49:28,061::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:28,061::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:28,062::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:28,062::__init__::232::IOProcess::(_processLogs) (41274) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:28,062::__init__::232::IOProcess::(_processLogs) (41274) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:28,063::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:28,063::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:28,063::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:28,063::__init__::232::IOProcess::(_processLogs) (41275) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:28,063::__init__::232::IOProcess::(_processLogs) (41275) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:28,063::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:28,063::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:28,064::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:28,064::__init__::232::IOProcess::(_processLogs) (41276) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:28,064::__init__::232::IOProcess::(_processLogs) (41276) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:28,064::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:28,064::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:28,064::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:28,064::__init__::232::IOProcess::(_processLogs) (41277) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:28,065::__init__::232::IOProcess::(_processLogs) (41277) Queuing response >Dummy-37::DEBUG::2014-09-16 10:49:29,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:29,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113227 s, 90.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:49:31,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:31,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112715 s, 90.8 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:49:32,928::task::595::Storage.TaskManager.Task::(_updateState) Task=`02040553-96ab-45d9-a0a6-372f3b983614`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:49:32,928::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:49:32,929::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000324774', 'lastCheck': '4.9', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036524', 'lastCheck': '4.9', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:49:32,929::task::1191::Storage.TaskManager.Task::(prepare) Task=`02040553-96ab-45d9-a0a6-372f3b983614`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000324774', 'lastCheck': '4.9', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036524', 'lastCheck': '4.9', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:49:32,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`02040553-96ab-45d9-a0a6-372f3b983614`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:49:32,929::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:49:32,929::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:49:32,929::task::993::Storage.TaskManager.Task::(_decref) Task=`02040553-96ab-45d9-a0a6-372f3b983614`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:49:33,311::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:49:33,311::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb08ef7c-43cd-4b8e-a6de-b690c69205d9`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:49:33,312::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:49:33,323::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:49:33,323::task::1191::Storage.TaskManager.Task::(prepare) Task=`fb08ef7c-43cd-4b8e-a6de-b690c69205d9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:49:33,323::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb08ef7c-43cd-4b8e-a6de-b690c69205d9`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:49:33,323::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:49:33,323::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:49:33,323::task::993::Storage.TaskManager.Task::(_decref) Task=`fb08ef7c-43cd-4b8e-a6de-b690c69205d9`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:49:33,364::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:49:33,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`694f119f-3cb3-4a22-b4a6-bc7bf8a1a6d9`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:49:33,364::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:49:33,365::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`a456c886-d718-4540-9a21-f5204ff9f2ac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:49:33,365::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:49:33,365::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:49:33,365::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`a456c886-d718-4540-9a21-f5204ff9f2ac`::Granted request >Thread-38::DEBUG::2014-09-16 10:49:33,366::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`694f119f-3cb3-4a22-b4a6-bc7bf8a1a6d9`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:49:33,366::task::993::Storage.TaskManager.Task::(_decref) Task=`694f119f-3cb3-4a22-b4a6-bc7bf8a1a6d9`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:49:33,378::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:49:33,378::task::1191::Storage.TaskManager.Task::(prepare) Task=`694f119f-3cb3-4a22-b4a6-bc7bf8a1a6d9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:49:33,378::task::595::Storage.TaskManager.Task::(_updateState) Task=`694f119f-3cb3-4a22-b4a6-bc7bf8a1a6d9`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:49:33,378::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:49:33,378::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:49:33,378::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:49:33,379::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:49:33,379::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:49:33,379::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:49:33,379::task::993::Storage.TaskManager.Task::(_decref) Task=`694f119f-3cb3-4a22-b4a6-bc7bf8a1a6d9`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:49:33,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:33,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115683 s, 88.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:49:35,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:35,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113755 s, 90.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:49:37,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:37,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112198 s, 91.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:49:38,050::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:38,050::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:38,050::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:38,050::__init__::232::IOProcess::(_processLogs) (41278) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:38,051::__init__::232::IOProcess::(_processLogs) (41278) Queuing response >Thread-47::DEBUG::2014-09-16 10:49:38,051::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:49:38,057::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000280683 s, 1.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:49:38,057::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:38,057::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:38,058::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:38,058::__init__::232::IOProcess::(_processLogs) (41279) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:38,058::__init__::232::IOProcess::(_processLogs) (41279) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:38,065::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:38,065::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:38,066::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:38,066::__init__::232::IOProcess::(_processLogs) (41280) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:38,066::__init__::232::IOProcess::(_processLogs) (41280) Queuing response >Thread-21::DEBUG::2014-09-16 10:49:38,067::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:49:38,072::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000309567 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:49:38,073::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:38,073::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:38,073::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:38,073::__init__::232::IOProcess::(_processLogs) (41281) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:38,074::__init__::232::IOProcess::(_processLogs) (41281) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:38,074::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:38,074::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:38,075::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:38,075::__init__::232::IOProcess::(_processLogs) (41282) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:38,075::__init__::232::IOProcess::(_processLogs) (41282) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:38,075::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:38,075::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:38,075::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:38,075::__init__::232::IOProcess::(_processLogs) (41283) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:38,076::__init__::232::IOProcess::(_processLogs) (41283) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:38,076::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:38,076::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:38,076::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:38,076::__init__::232::IOProcess::(_processLogs) (41284) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:38,076::__init__::232::IOProcess::(_processLogs) (41284) Queuing response >Dummy-37::DEBUG::2014-09-16 10:49:39,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:39,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117913 s, 86.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:49:41,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:41,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113569 s, 90.2 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:49:43,699::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:49:43,699::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0117592-1810-4f57-be93-687dca890453`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:49:43,700::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:49:43,710::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:49:43,711::task::1191::Storage.TaskManager.Task::(prepare) Task=`c0117592-1810-4f57-be93-687dca890453`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:49:43,711::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0117592-1810-4f57-be93-687dca890453`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:49:43,711::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:49:43,711::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:49:43,711::task::993::Storage.TaskManager.Task::(_decref) Task=`c0117592-1810-4f57-be93-687dca890453`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:49:43,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:43,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114158 s, 89.7 MB/s\n'; <rc> = 0 >Thread-38::DEBUG::2014-09-16 10:49:43,781::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:49:43,782::task::595::Storage.TaskManager.Task::(_updateState) Task=`87616852-cbee-46e5-af15-685cb59e42c7`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:49:43,783::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:49:43,784::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`1a20cedd-1da2-4ac4-9321-9a55baa9af59`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:49:43,784::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:49:43,785::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:49:43,786::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`1a20cedd-1da2-4ac4-9321-9a55baa9af59`::Granted request >Thread-38::DEBUG::2014-09-16 10:49:43,786::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`87616852-cbee-46e5-af15-685cb59e42c7`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:49:43,787::task::993::Storage.TaskManager.Task::(_decref) Task=`87616852-cbee-46e5-af15-685cb59e42c7`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:49:43,802::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:49:43,802::task::1191::Storage.TaskManager.Task::(prepare) Task=`87616852-cbee-46e5-af15-685cb59e42c7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:49:43,802::task::595::Storage.TaskManager.Task::(_updateState) Task=`87616852-cbee-46e5-af15-685cb59e42c7`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:49:43,802::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:49:43,803::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:49:43,803::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:49:43,803::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:49:43,803::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:49:43,803::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:49:43,803::task::993::Storage.TaskManager.Task::(_decref) Task=`87616852-cbee-46e5-af15-685cb59e42c7`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:49:45,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:45,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112877 s, 90.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:49:47,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:47,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113924 s, 89.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:49:48,059::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:48,059::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:48,059::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:48,059::__init__::232::IOProcess::(_processLogs) (41285) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:48,059::__init__::232::IOProcess::(_processLogs) (41285) Queuing response >Thread-47::DEBUG::2014-09-16 10:49:48,060::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:49:48,066::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000294714 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:49:48,066::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:48,066::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:48,067::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:48,067::__init__::232::IOProcess::(_processLogs) (41286) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:48,067::__init__::232::IOProcess::(_processLogs) (41286) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:48,077::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:48,077::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:48,077::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:48,078::__init__::232::IOProcess::(_processLogs) (41287) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:48,078::__init__::232::IOProcess::(_processLogs) (41287) Queuing response >Thread-21::DEBUG::2014-09-16 10:49:48,078::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:49:48,083::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000247876 s, 1.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:49:48,084::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:48,084::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:48,084::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:48,084::__init__::232::IOProcess::(_processLogs) (41288) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:48,084::__init__::232::IOProcess::(_processLogs) (41288) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:48,085::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:48,085::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:48,085::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:48,085::__init__::232::IOProcess::(_processLogs) (41289) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:48,086::__init__::232::IOProcess::(_processLogs) (41289) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:48,086::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:48,086::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:48,086::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:48,086::__init__::232::IOProcess::(_processLogs) (41290) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:48,086::__init__::232::IOProcess::(_processLogs) (41290) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:48,087::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:48,087::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:48,087::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:48,087::__init__::232::IOProcess::(_processLogs) (41291) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:48,087::__init__::232::IOProcess::(_processLogs) (41291) Queuing response >Thread-97::DEBUG::2014-09-16 10:49:48,835::task::595::Storage.TaskManager.Task::(_updateState) Task=`eef05f8b-9450-4dae-b96a-14381780e7d5`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:49:48,835::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:49:48,835::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000294714', 'lastCheck': '0.8', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000247876', 'lastCheck': '0.7', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:49:48,836::task::1191::Storage.TaskManager.Task::(prepare) Task=`eef05f8b-9450-4dae-b96a-14381780e7d5`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000294714', 'lastCheck': '0.8', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000247876', 'lastCheck': '0.7', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:49:48,836::task::595::Storage.TaskManager.Task::(_updateState) Task=`eef05f8b-9450-4dae-b96a-14381780e7d5`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:49:48,836::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:49:48,836::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:49:48,836::task::993::Storage.TaskManager.Task::(_decref) Task=`eef05f8b-9450-4dae-b96a-14381780e7d5`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:49:49,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:49,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112857 s, 90.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:49:51,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:51,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113189 s, 90.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:49:54,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:54,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113068 s, 90.6 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:49:54,058::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:49:54,059::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2f660b9-ac4e-4071-8d62-43bfc212b4dc`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:49:54,059::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:49:54,070::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:49:54,070::task::1191::Storage.TaskManager.Task::(prepare) Task=`d2f660b9-ac4e-4071-8d62-43bfc212b4dc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:49:54,070::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2f660b9-ac4e-4071-8d62-43bfc212b4dc`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:49:54,070::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:49:54,070::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:49:54,071::task::993::Storage.TaskManager.Task::(_decref) Task=`d2f660b9-ac4e-4071-8d62-43bfc212b4dc`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:49:54,117::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:49:54,117::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec2a1e02-bff4-4edb-ba99-38e7b0d281d7`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:49:54,117::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:49:54,118::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`6d2d4787-f66a-494d-b354-aabd3f602a5c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:49:54,118::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:49:54,118::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:49:54,118::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`6d2d4787-f66a-494d-b354-aabd3f602a5c`::Granted request >Thread-38::DEBUG::2014-09-16 10:49:54,118::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ec2a1e02-bff4-4edb-ba99-38e7b0d281d7`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:49:54,118::task::993::Storage.TaskManager.Task::(_decref) Task=`ec2a1e02-bff4-4edb-ba99-38e7b0d281d7`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:49:54,130::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:49:54,130::task::1191::Storage.TaskManager.Task::(prepare) Task=`ec2a1e02-bff4-4edb-ba99-38e7b0d281d7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:49:54,131::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec2a1e02-bff4-4edb-ba99-38e7b0d281d7`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:49:54,131::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:49:54,131::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:49:54,131::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:49:54,131::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:49:54,131::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:49:54,131::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:49:54,131::task::993::Storage.TaskManager.Task::(_decref) Task=`ec2a1e02-bff4-4edb-ba99-38e7b0d281d7`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:49:56,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:56,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113732 s, 90.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:49:58,068::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:58,068::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:58,068::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:58,068::__init__::232::IOProcess::(_processLogs) (41292) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:58,068::__init__::232::IOProcess::(_processLogs) (41292) Queuing response >Thread-47::DEBUG::2014-09-16 10:49:58,069::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:49:58,074::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000303177 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:49:58,075::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:58,075::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:58,075::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:58,075::__init__::232::IOProcess::(_processLogs) (41293) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:58,075::__init__::232::IOProcess::(_processLogs) (41293) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:58,088::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:58,088::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:58,088::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:58,088::__init__::232::IOProcess::(_processLogs) (41294) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:58,088::__init__::232::IOProcess::(_processLogs) (41294) Queuing response >Thread-21::DEBUG::2014-09-16 10:49:58,089::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:49:58,094::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000309379 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:49:58,095::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:58,095::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:58,095::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:58,095::__init__::232::IOProcess::(_processLogs) (41295) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:49:58,095::__init__::232::IOProcess::(_processLogs) (41295) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:58,096::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:58,096::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:58,096::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:58,096::__init__::232::IOProcess::(_processLogs) (41296) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:58,096::__init__::232::IOProcess::(_processLogs) (41296) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:58,097::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:58,097::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:58,097::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:58,097::__init__::232::IOProcess::(_processLogs) (41297) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:58,097::__init__::232::IOProcess::(_processLogs) (41297) Queuing response >Thread-14::DEBUG::2014-09-16 10:49:58,098::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:49:58,098::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:49:58,098::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:49:58,098::__init__::232::IOProcess::(_processLogs) (41298) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:49:58,098::__init__::232::IOProcess::(_processLogs) (41298) Queuing response >Dummy-37::DEBUG::2014-09-16 10:49:58,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:49:58,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113232 s, 90.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:50:00,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:00,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113832 s, 90.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:50:02,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:02,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113255 s, 90.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:50:04,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:04,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113341 s, 90.3 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:50:04,294::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:50:04,296::task::595::Storage.TaskManager.Task::(_updateState) Task=`7eff7acb-344a-4ece-a055-8b3f53ef7df5`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:50:04,296::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:50:04,308::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:50:04,308::task::1191::Storage.TaskManager.Task::(prepare) Task=`7eff7acb-344a-4ece-a055-8b3f53ef7df5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:50:04,308::task::595::Storage.TaskManager.Task::(_updateState) Task=`7eff7acb-344a-4ece-a055-8b3f53ef7df5`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:50:04,308::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:50:04,308::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:50:04,308::task::993::Storage.TaskManager.Task::(_decref) Task=`7eff7acb-344a-4ece-a055-8b3f53ef7df5`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:50:04,357::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:50:04,358::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c8275d8-8440-42ec-b955-2fbdeb0a6ba4`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:50:04,358::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:50:04,358::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`8b14df37-e83e-45b7-aae3-7e72a700459b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:50:04,358::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:50:04,358::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:50:04,358::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`8b14df37-e83e-45b7-aae3-7e72a700459b`::Granted request >Thread-38::DEBUG::2014-09-16 10:50:04,359::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6c8275d8-8440-42ec-b955-2fbdeb0a6ba4`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:50:04,359::task::993::Storage.TaskManager.Task::(_decref) Task=`6c8275d8-8440-42ec-b955-2fbdeb0a6ba4`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:50:04,371::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:50:04,371::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c8275d8-8440-42ec-b955-2fbdeb0a6ba4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:50:04,371::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c8275d8-8440-42ec-b955-2fbdeb0a6ba4`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:50:04,371::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:50:04,371::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:50:04,371::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:50:04,372::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:50:04,372::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:50:04,372::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:50:04,372::task::993::Storage.TaskManager.Task::(_decref) Task=`6c8275d8-8440-42ec-b955-2fbdeb0a6ba4`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:50:04,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b369860-ed03-4c1f-aa07-af6b4cfb5e9a`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:50:04,382::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:50:04,382::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000303177', 'lastCheck': '6.3', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309379', 'lastCheck': '6.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:50:04,382::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b369860-ed03-4c1f-aa07-af6b4cfb5e9a`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000303177', 'lastCheck': '6.3', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309379', 'lastCheck': '6.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:50:04,382::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b369860-ed03-4c1f-aa07-af6b4cfb5e9a`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:50:04,382::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:50:04,382::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:50:04,382::task::993::Storage.TaskManager.Task::(_decref) Task=`5b369860-ed03-4c1f-aa07-af6b4cfb5e9a`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:50:06,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:06,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113182 s, 90.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:50:08,077::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:08,077::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:08,077::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:08,077::__init__::232::IOProcess::(_processLogs) (41299) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:08,077::__init__::232::IOProcess::(_processLogs) (41299) Queuing response >Thread-47::DEBUG::2014-09-16 10:50:08,078::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:50:08,083::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000318777 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:50:08,084::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:08,084::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:08,084::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:08,084::__init__::232::IOProcess::(_processLogs) (41300) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:08,085::__init__::232::IOProcess::(_processLogs) (41300) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:08,099::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:08,099::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:08,099::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:08,099::__init__::232::IOProcess::(_processLogs) (41301) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:08,099::__init__::232::IOProcess::(_processLogs) (41301) Queuing response >Thread-21::DEBUG::2014-09-16 10:50:08,100::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:50:08,105::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000310447 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:50:08,106::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:08,106::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:08,106::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:08,106::__init__::232::IOProcess::(_processLogs) (41302) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:08,106::__init__::232::IOProcess::(_processLogs) (41302) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:08,107::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:08,107::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:08,107::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:08,108::__init__::232::IOProcess::(_processLogs) (41303) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:08,108::__init__::232::IOProcess::(_processLogs) (41303) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:08,108::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:08,108::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:08,108::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:08,108::__init__::232::IOProcess::(_processLogs) (41304) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:08,108::__init__::232::IOProcess::(_processLogs) (41304) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:08,109::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:08,109::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:08,109::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:08,109::__init__::232::IOProcess::(_processLogs) (41305) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:08,109::__init__::232::IOProcess::(_processLogs) (41305) Queuing response >Dummy-37::DEBUG::2014-09-16 10:50:08,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:08,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114351 s, 89.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:50:10,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:10,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112863 s, 90.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:50:12,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:12,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113901 s, 89.9 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:50:14,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:14,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0205092 s, 49.9 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:50:14,577::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:50:14,579::task::595::Storage.TaskManager.Task::(_updateState) Task=`9615257b-6dd9-49be-b331-ca3471e4752e`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:50:14,580::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:50:14,593::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:50:14,594::task::1191::Storage.TaskManager.Task::(prepare) Task=`9615257b-6dd9-49be-b331-ca3471e4752e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:50:14,594::task::595::Storage.TaskManager.Task::(_updateState) Task=`9615257b-6dd9-49be-b331-ca3471e4752e`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:50:14,595::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:50:14,596::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:50:14,597::task::993::Storage.TaskManager.Task::(_decref) Task=`9615257b-6dd9-49be-b331-ca3471e4752e`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:50:14,687::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:50:14,688::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7f75f65-6c43-4967-814a-6470991f78ac`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:50:14,688::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:50:14,690::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`2ed4cfcf-a4b4-45f3-8eed-0412b7e5b374`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:50:14,690::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:50:14,691::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:50:14,691::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`2ed4cfcf-a4b4-45f3-8eed-0412b7e5b374`::Granted request >Thread-38::DEBUG::2014-09-16 10:50:14,692::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b7f75f65-6c43-4967-814a-6470991f78ac`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:50:14,693::task::993::Storage.TaskManager.Task::(_decref) Task=`b7f75f65-6c43-4967-814a-6470991f78ac`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:50:14,709::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:50:14,709::task::1191::Storage.TaskManager.Task::(prepare) Task=`b7f75f65-6c43-4967-814a-6470991f78ac`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:50:14,710::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7f75f65-6c43-4967-814a-6470991f78ac`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:50:14,710::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:50:14,710::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:50:14,711::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:50:14,712::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:50:14,712::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:50:14,713::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:50:14,713::task::993::Storage.TaskManager.Task::(_decref) Task=`b7f75f65-6c43-4967-814a-6470991f78ac`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:50:16,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:16,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113422 s, 90.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:50:18,086::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:18,086::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:18,086::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:18,086::__init__::232::IOProcess::(_processLogs) (41306) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:18,086::__init__::232::IOProcess::(_processLogs) (41306) Queuing response >Thread-47::DEBUG::2014-09-16 10:50:18,087::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:50:18,092::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000297184 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:50:18,093::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:18,093::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:18,093::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:18,093::__init__::232::IOProcess::(_processLogs) (41307) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:18,093::__init__::232::IOProcess::(_processLogs) (41307) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:18,110::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:18,110::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:18,110::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:18,110::__init__::232::IOProcess::(_processLogs) (41308) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:18,111::__init__::232::IOProcess::(_processLogs) (41308) Queuing response >Thread-21::DEBUG::2014-09-16 10:50:18,111::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:50:18,116::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000273316 s, 1.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:50:18,117::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:18,117::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:18,117::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:18,117::__init__::232::IOProcess::(_processLogs) (41309) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:18,117::__init__::232::IOProcess::(_processLogs) (41309) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:18,118::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:18,118::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:18,118::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:18,118::__init__::232::IOProcess::(_processLogs) (41310) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:18,118::__init__::232::IOProcess::(_processLogs) (41310) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:18,119::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:18,119::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:18,119::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:18,119::__init__::232::IOProcess::(_processLogs) (41311) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:18,119::__init__::232::IOProcess::(_processLogs) (41311) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:18,120::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:18,120::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:18,120::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:18,120::__init__::232::IOProcess::(_processLogs) (41312) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:18,120::__init__::232::IOProcess::(_processLogs) (41312) Queuing response >Dummy-37::DEBUG::2014-09-16 10:50:18,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:18,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113084 s, 90.6 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:50:20,594::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a8e1183-bdad-4c65-baf2-5db8f924705c`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:50:20,595::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:50:20,595::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297184', 'lastCheck': '2.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273316', 'lastCheck': '2.5', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:50:20,595::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a8e1183-bdad-4c65-baf2-5db8f924705c`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297184', 'lastCheck': '2.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273316', 'lastCheck': '2.5', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:50:20,595::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a8e1183-bdad-4c65-baf2-5db8f924705c`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:50:20,595::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:50:20,595::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:50:20,595::task::993::Storage.TaskManager.Task::(_decref) Task=`2a8e1183-bdad-4c65-baf2-5db8f924705c`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:50:20,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:20,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114833 s, 89.2 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:50:22,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:22,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113362 s, 90.3 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:50:24,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:24,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112623 s, 90.9 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:50:25,120::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:50:25,121::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8e1245e-fa13-41de-8669-f76e1d1a861b`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:50:25,121::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:50:25,133::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:50:25,133::task::1191::Storage.TaskManager.Task::(prepare) Task=`c8e1245e-fa13-41de-8669-f76e1d1a861b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:50:25,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8e1245e-fa13-41de-8669-f76e1d1a861b`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:50:25,133::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:50:25,133::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:50:25,133::task::993::Storage.TaskManager.Task::(_decref) Task=`c8e1245e-fa13-41de-8669-f76e1d1a861b`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:50:25,175::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:50:25,176::task::595::Storage.TaskManager.Task::(_updateState) Task=`b570cf88-60c7-4e76-89c7-9d3620fe99ba`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:50:25,176::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:50:25,176::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`1c60eb40-045a-479c-a9c7-838c00c89129`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:50:25,176::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:50:25,176::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:50:25,176::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`1c60eb40-045a-479c-a9c7-838c00c89129`::Granted request >Thread-38::DEBUG::2014-09-16 10:50:25,177::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b570cf88-60c7-4e76-89c7-9d3620fe99ba`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:50:25,177::task::993::Storage.TaskManager.Task::(_decref) Task=`b570cf88-60c7-4e76-89c7-9d3620fe99ba`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:50:25,189::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:50:25,189::task::1191::Storage.TaskManager.Task::(prepare) Task=`b570cf88-60c7-4e76-89c7-9d3620fe99ba`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:50:25,189::task::595::Storage.TaskManager.Task::(_updateState) Task=`b570cf88-60c7-4e76-89c7-9d3620fe99ba`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:50:25,189::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:50:25,189::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:50:25,189::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:50:25,190::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:50:25,190::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:50:25,190::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:50:25,190::task::993::Storage.TaskManager.Task::(_decref) Task=`b570cf88-60c7-4e76-89c7-9d3620fe99ba`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:50:26,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:26,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118153 s, 86.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:50:28,095::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:28,095::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:28,095::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:28,095::__init__::232::IOProcess::(_processLogs) (41313) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:28,095::__init__::232::IOProcess::(_processLogs) (41313) Queuing response >Thread-47::DEBUG::2014-09-16 10:50:28,096::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:50:28,101::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000330435 s, 984 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:50:28,102::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:28,102::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:28,102::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:28,102::__init__::232::IOProcess::(_processLogs) (41314) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:28,102::__init__::232::IOProcess::(_processLogs) (41314) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:28,121::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:28,121::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:28,121::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:28,121::__init__::232::IOProcess::(_processLogs) (41315) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:28,121::__init__::232::IOProcess::(_processLogs) (41315) Queuing response >Thread-21::DEBUG::2014-09-16 10:50:28,122::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:50:28,127::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000309984 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:50:28,128::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:28,128::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:28,128::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:28,128::__init__::232::IOProcess::(_processLogs) (41316) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:28,128::__init__::232::IOProcess::(_processLogs) (41316) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:28,129::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:28,129::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:28,129::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:28,129::__init__::232::IOProcess::(_processLogs) (41317) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:28,129::__init__::232::IOProcess::(_processLogs) (41317) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:28,130::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:28,130::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:28,130::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:28,130::__init__::232::IOProcess::(_processLogs) (41318) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:28,130::__init__::232::IOProcess::(_processLogs) (41318) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:28,131::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:28,131::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:28,131::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:28,131::__init__::232::IOProcess::(_processLogs) (41319) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:28,131::__init__::232::IOProcess::(_processLogs) (41319) Queuing response >Dummy-37::DEBUG::2014-09-16 10:50:28,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:28,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116916 s, 87.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:50:30,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:31,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115406 s, 88.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:50:33,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:33,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112636 s, 90.9 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:50:35,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:35,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112736 s, 90.8 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:50:35,529::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:50:35,530::task::595::Storage.TaskManager.Task::(_updateState) Task=`4aae799e-37da-47dc-8442-47cff42aae14`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:50:35,530::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:50:35,541::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:50:35,541::task::1191::Storage.TaskManager.Task::(prepare) Task=`4aae799e-37da-47dc-8442-47cff42aae14`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:50:35,541::task::595::Storage.TaskManager.Task::(_updateState) Task=`4aae799e-37da-47dc-8442-47cff42aae14`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:50:35,542::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:50:35,542::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:50:35,542::task::993::Storage.TaskManager.Task::(_decref) Task=`4aae799e-37da-47dc-8442-47cff42aae14`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:50:35,578::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:50:35,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1ab75a0-20a3-40f0-be2a-2c757e4d488c`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:50:35,578::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:50:35,579::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`0e51fd47-f69b-42ad-b148-89ea599b8a2a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:50:35,579::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:50:35,579::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:50:35,579::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`0e51fd47-f69b-42ad-b148-89ea599b8a2a`::Granted request >Thread-38::DEBUG::2014-09-16 10:50:35,579::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e1ab75a0-20a3-40f0-be2a-2c757e4d488c`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:50:35,579::task::993::Storage.TaskManager.Task::(_decref) Task=`e1ab75a0-20a3-40f0-be2a-2c757e4d488c`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:50:35,591::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:50:35,592::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1ab75a0-20a3-40f0-be2a-2c757e4d488c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:50:35,592::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1ab75a0-20a3-40f0-be2a-2c757e4d488c`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:50:35,592::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:50:35,592::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:50:35,592::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:50:35,592::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:50:35,592::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:50:35,592::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:50:35,592::task::993::Storage.TaskManager.Task::(_decref) Task=`e1ab75a0-20a3-40f0-be2a-2c757e4d488c`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:50:36,570::task::595::Storage.TaskManager.Task::(_updateState) Task=`6fc02c86-0ba1-4041-b4e0-efd6e199bc0b`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:50:36,570::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:50:36,570::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000330435', 'lastCheck': '8.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309984', 'lastCheck': '8.4', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:50:36,570::task::1191::Storage.TaskManager.Task::(prepare) Task=`6fc02c86-0ba1-4041-b4e0-efd6e199bc0b`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000330435', 'lastCheck': '8.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309984', 'lastCheck': '8.4', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:50:36,570::task::595::Storage.TaskManager.Task::(_updateState) Task=`6fc02c86-0ba1-4041-b4e0-efd6e199bc0b`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:50:36,570::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:50:36,570::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:50:36,571::task::993::Storage.TaskManager.Task::(_decref) Task=`6fc02c86-0ba1-4041-b4e0-efd6e199bc0b`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:50:37,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:37,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113835 s, 90.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:50:38,103::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:38,104::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:38,104::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:38,104::__init__::232::IOProcess::(_processLogs) (41320) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:38,104::__init__::232::IOProcess::(_processLogs) (41320) Queuing response >Thread-47::DEBUG::2014-09-16 10:50:38,105::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:50:38,110::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000290377 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:50:38,111::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:38,111::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:38,111::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:38,111::__init__::232::IOProcess::(_processLogs) (41321) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:38,111::__init__::232::IOProcess::(_processLogs) (41321) Queuing response >Thread-21::DEBUG::2014-09-16 10:50:38,132::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain b66bf4f1-94ad-487c-aa76-34598a679d7b >Thread-14::DEBUG::2014-09-16 10:50:38,133::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:38,133::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:38,133::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:38,133::__init__::232::IOProcess::(_processLogs) (41322) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:50:38,134::__init__::232::IOProcess::(_processLogs) (41322) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:38,134::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:38,135::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:38,136::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:38,136::__init__::232::IOProcess::(_processLogs) (41323) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:50:38,137::__init__::232::IOProcess::(_processLogs) (41323) Queuing response >Thread-21::DEBUG::2014-09-16 10:50:38,139::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b >Thread-14::DEBUG::2014-09-16 10:50:38,139::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:38,139::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:38,139::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:38,140::__init__::232::IOProcess::(_processLogs) (41324) Got request for method 'touch' >Thread-14::DEBUG::2014-09-16 10:50:38,141::__init__::232::IOProcess::(_processLogs) (41324) Queuing response >Thread-21::DEBUG::2014-09-16 10:50:38,141::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14::DEBUG::2014-09-16 10:50:38,141::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:38,142::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:38,142::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:38,142::__init__::232::IOProcess::(_processLogs) (41325) Got request for method 'readfile' >Thread-14::DEBUG::2014-09-16 10:50:38,143::__init__::232::IOProcess::(_processLogs) (41325) Queuing response >Thread-21::DEBUG::2014-09-16 10:50:38,143::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfs_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Global_DC_1', 'POOL_DOMAINS=b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=da06caa7-b08d-4685-b49c-84565c268648', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Master', 'SDUUID=b66bf4f1-94ad-487c-aa76-34598a679d7b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=895c938b406aa5adedd20a81fb4f17d5cf909767'] >Thread-14::DEBUG::2014-09-16 10:50:38,143::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:38,143::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:38,144::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:38,144::__init__::232::IOProcess::(_processLogs) (41326) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:38,144::__init__::232::IOProcess::(_processLogs) (41326) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:38,144::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:38,144::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:38,144::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:38,144::__init__::232::IOProcess::(_processLogs) (41327) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:50:38,145::__init__::232::IOProcess::(_processLogs) (41327) Queuing response >Thread-21::DEBUG::2014-09-16 10:50:38,145::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-21::INFO::2014-09-16 10:50:38,145::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b66bf4f1-94ad-487c-aa76-34598a679d7b_imageNS already registered >Thread-21::INFO::2014-09-16 10:50:38,145::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b66bf4f1-94ad-487c-aa76-34598a679d7b_volumeNS already registered >Thread-14::DEBUG::2014-09-16 10:50:38,146::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:38,146::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:38,146::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:38,146::__init__::232::IOProcess::(_processLogs) (41328) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:38,146::__init__::232::IOProcess::(_processLogs) (41328) Queuing response >Thread-21::DEBUG::2014-09-16 10:50:38,146::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:50:38,152::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000324142 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:50:38,153::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:38,153::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:38,153::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:38,153::__init__::232::IOProcess::(_processLogs) (41329) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:38,153::__init__::232::IOProcess::(_processLogs) (41329) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:38,154::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:38,154::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:38,154::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:38,154::__init__::232::IOProcess::(_processLogs) (41330) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:38,154::__init__::232::IOProcess::(_processLogs) (41330) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:38,155::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:38,155::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:38,155::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:38,155::__init__::232::IOProcess::(_processLogs) (41331) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:38,155::__init__::232::IOProcess::(_processLogs) (41331) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:38,156::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:38,156::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:38,156::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:38,156::__init__::232::IOProcess::(_processLogs) (41332) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:38,156::__init__::232::IOProcess::(_processLogs) (41332) Queuing response >Dummy-37::DEBUG::2014-09-16 10:50:39,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:39,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114577 s, 89.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:50:41,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:41,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113193 s, 90.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:50:43,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:43,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112301 s, 91.2 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:50:45,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:45,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113029 s, 90.6 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:50:45,723::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:50:45,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`096f7aa2-d361-4b2d-8014-a53408f0540e`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:50:45,723::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:50:45,735::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:50:45,735::task::1191::Storage.TaskManager.Task::(prepare) Task=`096f7aa2-d361-4b2d-8014-a53408f0540e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:50:45,735::task::595::Storage.TaskManager.Task::(_updateState) Task=`096f7aa2-d361-4b2d-8014-a53408f0540e`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:50:45,735::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:50:45,735::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:50:45,735::task::993::Storage.TaskManager.Task::(_decref) Task=`096f7aa2-d361-4b2d-8014-a53408f0540e`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:50:45,770::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:50:45,770::task::595::Storage.TaskManager.Task::(_updateState) Task=`81a20c3c-efbc-422f-8576-22de3ece2d97`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:50:45,770::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:50:45,771::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`1b78d15e-ce0e-4d32-9b06-b5386dfb4bc1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:50:45,771::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:50:45,771::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:50:45,771::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`1b78d15e-ce0e-4d32-9b06-b5386dfb4bc1`::Granted request >Thread-38::DEBUG::2014-09-16 10:50:45,771::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`81a20c3c-efbc-422f-8576-22de3ece2d97`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:50:45,771::task::993::Storage.TaskManager.Task::(_decref) Task=`81a20c3c-efbc-422f-8576-22de3ece2d97`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:50:45,783::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:50:45,783::task::1191::Storage.TaskManager.Task::(prepare) Task=`81a20c3c-efbc-422f-8576-22de3ece2d97`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:50:45,784::task::595::Storage.TaskManager.Task::(_updateState) Task=`81a20c3c-efbc-422f-8576-22de3ece2d97`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:50:45,784::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:50:45,784::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:50:45,784::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:50:45,784::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:50:45,784::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:50:45,784::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:50:45,784::task::993::Storage.TaskManager.Task::(_decref) Task=`81a20c3c-efbc-422f-8576-22de3ece2d97`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:50:47,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:47,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113125 s, 90.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:50:48,112::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:48,112::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:48,113::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:48,113::__init__::232::IOProcess::(_processLogs) (41333) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:48,113::__init__::232::IOProcess::(_processLogs) (41333) Queuing response >Thread-47::DEBUG::2014-09-16 10:50:48,113::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:50:48,119::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000331292 s, 981 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:50:48,120::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:48,120::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:48,120::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:48,120::__init__::232::IOProcess::(_processLogs) (41334) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:48,121::__init__::232::IOProcess::(_processLogs) (41334) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:48,157::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:48,157::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:48,157::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:48,157::__init__::232::IOProcess::(_processLogs) (41335) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:48,157::__init__::232::IOProcess::(_processLogs) (41335) Queuing response >Thread-21::DEBUG::2014-09-16 10:50:48,158::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:50:48,163::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000341948 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:50:48,164::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:48,164::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:48,164::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:48,164::__init__::232::IOProcess::(_processLogs) (41336) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:48,164::__init__::232::IOProcess::(_processLogs) (41336) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:48,165::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:48,165::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:48,165::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:48,165::__init__::232::IOProcess::(_processLogs) (41337) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:48,165::__init__::232::IOProcess::(_processLogs) (41337) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:48,166::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:48,166::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:48,166::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:48,166::__init__::232::IOProcess::(_processLogs) (41338) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:48,166::__init__::232::IOProcess::(_processLogs) (41338) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:48,167::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:48,167::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:48,167::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:48,167::__init__::232::IOProcess::(_processLogs) (41339) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:48,167::__init__::232::IOProcess::(_processLogs) (41339) Queuing response >Dummy-37::DEBUG::2014-09-16 10:50:49,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:49,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113363 s, 90.3 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:50:51,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:51,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112101 s, 91.3 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:50:53,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:53,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113029 s, 90.6 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:50:53,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`ace6918b-6239-4103-a360-e3415afce1d9`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:50:53,796::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:50:53,796::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000331292', 'lastCheck': '5.7', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341948', 'lastCheck': '5.6', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:50:53,796::task::1191::Storage.TaskManager.Task::(prepare) Task=`ace6918b-6239-4103-a360-e3415afce1d9`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000331292', 'lastCheck': '5.7', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341948', 'lastCheck': '5.6', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:50:53,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`ace6918b-6239-4103-a360-e3415afce1d9`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:50:53,796::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:50:53,797::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:50:53,797::task::993::Storage.TaskManager.Task::(_decref) Task=`ace6918b-6239-4103-a360-e3415afce1d9`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:50:55,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:50:55,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011593 s, 88.3 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:50:55,993::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:50:55,993::task::595::Storage.TaskManager.Task::(_updateState) Task=`8dbafd6a-21f1-4377-8177-20d42a1200c2`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:50:55,993::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:50:56,004::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:50:56,005::task::1191::Storage.TaskManager.Task::(prepare) Task=`8dbafd6a-21f1-4377-8177-20d42a1200c2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:50:56,005::task::595::Storage.TaskManager.Task::(_updateState) Task=`8dbafd6a-21f1-4377-8177-20d42a1200c2`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:50:56,005::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:50:56,005::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:50:56,005::task::993::Storage.TaskManager.Task::(_decref) Task=`8dbafd6a-21f1-4377-8177-20d42a1200c2`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:50:56,034::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:50:56,034::task::595::Storage.TaskManager.Task::(_updateState) Task=`32a6c592-bd5d-4573-88f7-d920b74b4e20`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:50:56,035::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:50:56,035::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`5bcddddf-b461-4094-881b-d61756407c2e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:50:56,035::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:50:56,035::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:50:56,035::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`5bcddddf-b461-4094-881b-d61756407c2e`::Granted request >Thread-38::DEBUG::2014-09-16 10:50:56,035::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`32a6c592-bd5d-4573-88f7-d920b74b4e20`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:50:56,035::task::993::Storage.TaskManager.Task::(_decref) Task=`32a6c592-bd5d-4573-88f7-d920b74b4e20`::ref 1 aborting False >Dummy-37::DEBUG::2014-09-16 10:50:57,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-09-16 10:50:58,122::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:58,122::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:58,122::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:58,122::__init__::232::IOProcess::(_processLogs) (41340) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:58,168::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:58,168::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:58,168::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:58,168::__init__::232::IOProcess::(_processLogs) (41341) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:58,613::__init__::232::IOProcess::(_processLogs) (41341) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:58,614::__init__::232::IOProcess::(_processLogs) (41340) Queuing response >Thread-38::INFO::2014-09-16 10:50:58,614::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:50:58,615::task::1191::Storage.TaskManager.Task::(prepare) Task=`32a6c592-bd5d-4573-88f7-d920b74b4e20`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:50:58,615::task::595::Storage.TaskManager.Task::(_updateState) Task=`32a6c592-bd5d-4573-88f7-d920b74b4e20`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:50:58,616::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:50:58,616::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-21::DEBUG::2014-09-16 10:50:58,618::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-38::DEBUG::2014-09-16 10:50:58,619::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-47::DEBUG::2014-09-16 10:50:58,626::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-38::DEBUG::2014-09-16 10:50:58,627::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-21::DEBUG::2014-09-16 10:50:58,633::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000262047 s, 1.7 MB/s\n'; <rc> = 0 >Thread-38::DEBUG::2014-09-16 10:50:58,633::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:50:58,635::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-47::DEBUG::2014-09-16 10:50:58,636::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.00025243 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:50:58,637::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:58,638::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-38::DEBUG::2014-09-16 10:50:58,638::task::993::Storage.TaskManager.Task::(_decref) Task=`32a6c592-bd5d-4573-88f7-d920b74b4e20`::ref 0 aborting False >Thread-14::DEBUG::2014-09-16 10:50:58,639::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:58,640::__init__::232::IOProcess::(_processLogs) (41342) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:58,642::__init__::232::IOProcess::(_processLogs) (41342) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:58,646::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:58,647::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:58,647::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:58,648::__init__::232::IOProcess::(_processLogs) (41343) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:50:58,648::__init__::232::IOProcess::(_processLogs) (41343) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:58,651::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:58,651::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:58,652::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:58,652::__init__::232::IOProcess::(_processLogs) (41344) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:58,676::__init__::232::IOProcess::(_processLogs) (41344) Queuing response >Dummy-37::DEBUG::2014-09-16 10:50:58,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387682 s, 26.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:50:58,678::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:58,679::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:58,679::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:58,680::__init__::232::IOProcess::(_processLogs) (41345) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:58,680::__init__::232::IOProcess::(_processLogs) (41345) Queuing response >Thread-14::DEBUG::2014-09-16 10:50:58,682::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:50:58,682::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:50:58,682::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:50:58,683::__init__::232::IOProcess::(_processLogs) (41346) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:50:58,683::__init__::232::IOProcess::(_processLogs) (41346) Queuing response >Dummy-37::DEBUG::2014-09-16 10:51:00,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:00,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112648 s, 90.9 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:51:02,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:02,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011378 s, 90.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:51:04,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:04,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113092 s, 90.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:51:06,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:06,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114142 s, 89.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:51:08,652::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:08,652::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:08,652::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:08,652::__init__::232::IOProcess::(_processLogs) (41347) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:08,652::__init__::232::IOProcess::(_processLogs) (41347) Queuing response >Thread-47::DEBUG::2014-09-16 10:51:08,653::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:51:08,659::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000290073 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:51:08,659::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:08,660::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:08,660::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:08,660::__init__::232::IOProcess::(_processLogs) (41348) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:08,660::__init__::232::IOProcess::(_processLogs) (41348) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:08,685::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:08,685::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:08,685::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:08,685::__init__::232::IOProcess::(_processLogs) (41349) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:08,685::__init__::232::IOProcess::(_processLogs) (41349) Queuing response >Thread-21::DEBUG::2014-09-16 10:51:08,686::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:51:08,691::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000351564 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:51:08,692::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:08,692::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:08,692::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:08,692::__init__::232::IOProcess::(_processLogs) (41350) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:08,692::__init__::232::IOProcess::(_processLogs) (41350) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:08,693::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:08,693::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:08,693::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:08,693::__init__::232::IOProcess::(_processLogs) (41351) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:08,694::__init__::232::IOProcess::(_processLogs) (41351) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:08,694::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:08,694::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:08,694::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:08,694::__init__::232::IOProcess::(_processLogs) (41352) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:08,694::__init__::232::IOProcess::(_processLogs) (41352) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:08,695::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:08,695::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:08,695::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:08,695::__init__::232::IOProcess::(_processLogs) (41353) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:08,695::__init__::232::IOProcess::(_processLogs) (41353) Queuing response >Thread-97::DEBUG::2014-09-16 10:51:08,803::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:51:08,803::task::595::Storage.TaskManager.Task::(_updateState) Task=`9839c60b-4a5e-4d99-9706-220232f38393`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:51:08,804::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:51:08,815::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:51:08,815::task::1191::Storage.TaskManager.Task::(prepare) Task=`9839c60b-4a5e-4d99-9706-220232f38393`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:51:08,815::task::595::Storage.TaskManager.Task::(_updateState) Task=`9839c60b-4a5e-4d99-9706-220232f38393`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:51:08,815::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:51:08,815::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:51:08,816::task::993::Storage.TaskManager.Task::(_decref) Task=`9839c60b-4a5e-4d99-9706-220232f38393`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:51:08,849::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:51:08,849::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d0b141a-fe34-4041-bade-f1531f8e8a9c`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:51:08,849::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:51:08,849::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`1150ecac-9b06-4789-8f8d-2995321c502f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:51:08,849::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:51:08,849::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:51:08,849::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`1150ecac-9b06-4789-8f8d-2995321c502f`::Granted request >Thread-38::DEBUG::2014-09-16 10:51:08,850::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8d0b141a-fe34-4041-bade-f1531f8e8a9c`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:51:08,850::task::993::Storage.TaskManager.Task::(_decref) Task=`8d0b141a-fe34-4041-bade-f1531f8e8a9c`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:51:08,862::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:51:08,862::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d0b141a-fe34-4041-bade-f1531f8e8a9c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:51:08,862::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d0b141a-fe34-4041-bade-f1531f8e8a9c`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:51:08,862::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:51:08,862::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:51:08,862::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:51:08,862::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:51:08,862::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:51:08,863::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:51:08,863::task::993::Storage.TaskManager.Task::(_decref) Task=`8d0b141a-fe34-4041-bade-f1531f8e8a9c`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:51:08,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:08,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112875 s, 90.7 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:51:09,974::task::595::Storage.TaskManager.Task::(_updateState) Task=`2aafe6aa-648b-42fe-a0a3-532c7ea1bf01`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:51:09,974::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:51:09,975::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000290073', 'lastCheck': '1.3', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000351564', 'lastCheck': '1.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:51:09,975::task::1191::Storage.TaskManager.Task::(prepare) Task=`2aafe6aa-648b-42fe-a0a3-532c7ea1bf01`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000290073', 'lastCheck': '1.3', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000351564', 'lastCheck': '1.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:51:09,975::task::595::Storage.TaskManager.Task::(_updateState) Task=`2aafe6aa-648b-42fe-a0a3-532c7ea1bf01`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:51:09,975::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:51:09,975::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:51:09,975::task::993::Storage.TaskManager.Task::(_decref) Task=`2aafe6aa-648b-42fe-a0a3-532c7ea1bf01`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:51:10,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:10,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0111564 s, 91.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:51:12,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:13,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114317 s, 89.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:51:15,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:15,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113016 s, 90.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:51:17,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:17,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113439 s, 90.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:51:18,661::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:18,661::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:18,661::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:18,661::__init__::232::IOProcess::(_processLogs) (41354) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:18,662::__init__::232::IOProcess::(_processLogs) (41354) Queuing response >Thread-47::DEBUG::2014-09-16 10:51:18,662::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:51:18,668::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000301216 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:51:18,668::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:18,668::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:18,668::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:18,669::__init__::232::IOProcess::(_processLogs) (41355) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:18,669::__init__::232::IOProcess::(_processLogs) (41355) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:18,696::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:18,696::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:18,696::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:18,696::__init__::232::IOProcess::(_processLogs) (41356) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:18,697::__init__::232::IOProcess::(_processLogs) (41356) Queuing response >Thread-21::DEBUG::2014-09-16 10:51:18,697::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:51:18,702::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000248401 s, 1.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:51:18,703::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:18,703::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:18,703::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:18,703::__init__::232::IOProcess::(_processLogs) (41357) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:18,703::__init__::232::IOProcess::(_processLogs) (41357) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:18,704::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:18,704::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:18,704::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:18,704::__init__::232::IOProcess::(_processLogs) (41358) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:18,705::__init__::232::IOProcess::(_processLogs) (41358) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:18,705::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:18,705::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:18,705::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:18,705::__init__::232::IOProcess::(_processLogs) (41359) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:18,705::__init__::232::IOProcess::(_processLogs) (41359) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:18,706::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:18,706::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:18,706::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:18,706::__init__::232::IOProcess::(_processLogs) (41360) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:18,706::__init__::232::IOProcess::(_processLogs) (41360) Queuing response >Dummy-37::DEBUG::2014-09-16 10:51:19,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:19,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01127 s, 90.9 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:51:19,489::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:51:19,490::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c93dbb8-a4c6-485e-b9d2-06fd77dbdd52`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:51:19,490::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:51:19,502::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:51:19,502::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c93dbb8-a4c6-485e-b9d2-06fd77dbdd52`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:51:19,502::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c93dbb8-a4c6-485e-b9d2-06fd77dbdd52`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:51:19,502::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:51:19,502::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:51:19,502::task::993::Storage.TaskManager.Task::(_decref) Task=`9c93dbb8-a4c6-485e-b9d2-06fd77dbdd52`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:51:19,535::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:51:19,535::task::595::Storage.TaskManager.Task::(_updateState) Task=`72c45f2b-2473-40a6-982e-5f14037d23ad`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:51:19,535::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:51:19,535::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`3aedba96-881d-4e73-94a9-158d98bd1628`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:51:19,536::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:51:19,536::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:51:19,536::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`3aedba96-881d-4e73-94a9-158d98bd1628`::Granted request >Thread-38::DEBUG::2014-09-16 10:51:19,536::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`72c45f2b-2473-40a6-982e-5f14037d23ad`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:51:19,536::task::993::Storage.TaskManager.Task::(_decref) Task=`72c45f2b-2473-40a6-982e-5f14037d23ad`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:51:19,548::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:51:19,548::task::1191::Storage.TaskManager.Task::(prepare) Task=`72c45f2b-2473-40a6-982e-5f14037d23ad`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:51:19,548::task::595::Storage.TaskManager.Task::(_updateState) Task=`72c45f2b-2473-40a6-982e-5f14037d23ad`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:51:19,548::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:51:19,548::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:51:19,549::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:51:19,549::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:51:19,549::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:51:19,549::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:51:19,549::task::993::Storage.TaskManager.Task::(_decref) Task=`72c45f2b-2473-40a6-982e-5f14037d23ad`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:51:21,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:21,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117723 s, 87.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:51:23,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:23,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113126 s, 90.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:51:25,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:25,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113282 s, 90.4 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:51:25,410::task::595::Storage.TaskManager.Task::(_updateState) Task=`7191a96f-c1c5-4670-90cd-203214ba3930`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:51:25,410::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:51:25,410::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000301216', 'lastCheck': '6.7', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000248401', 'lastCheck': '6.7', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:51:25,410::task::1191::Storage.TaskManager.Task::(prepare) Task=`7191a96f-c1c5-4670-90cd-203214ba3930`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000301216', 'lastCheck': '6.7', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000248401', 'lastCheck': '6.7', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:51:25,410::task::595::Storage.TaskManager.Task::(_updateState) Task=`7191a96f-c1c5-4670-90cd-203214ba3930`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:51:25,410::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:51:25,410::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:51:25,410::task::993::Storage.TaskManager.Task::(_decref) Task=`7191a96f-c1c5-4670-90cd-203214ba3930`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:51:27,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:27,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114209 s, 89.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:51:28,670::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:28,670::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:28,670::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:28,670::__init__::232::IOProcess::(_processLogs) (41361) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:28,670::__init__::232::IOProcess::(_processLogs) (41361) Queuing response >Thread-47::DEBUG::2014-09-16 10:51:28,671::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:51:28,676::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000291012 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:51:28,677::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:28,677::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:28,677::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:28,677::__init__::232::IOProcess::(_processLogs) (41362) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:28,677::__init__::232::IOProcess::(_processLogs) (41362) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:28,707::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:28,707::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:28,707::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:28,707::__init__::232::IOProcess::(_processLogs) (41363) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:28,707::__init__::232::IOProcess::(_processLogs) (41363) Queuing response >Thread-21::DEBUG::2014-09-16 10:51:28,708::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:51:28,713::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000316292 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:51:28,714::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:28,714::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:28,714::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:28,714::__init__::232::IOProcess::(_processLogs) (41364) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:28,714::__init__::232::IOProcess::(_processLogs) (41364) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:28,715::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:28,715::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:28,715::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:28,715::__init__::232::IOProcess::(_processLogs) (41365) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:28,715::__init__::232::IOProcess::(_processLogs) (41365) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:28,716::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:28,716::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:28,716::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:28,716::__init__::232::IOProcess::(_processLogs) (41366) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:28,716::__init__::232::IOProcess::(_processLogs) (41366) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:28,717::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:28,717::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:28,717::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:28,717::__init__::232::IOProcess::(_processLogs) (41367) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:28,717::__init__::232::IOProcess::(_processLogs) (41367) Queuing response >Dummy-37::DEBUG::2014-09-16 10:51:29,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:29,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113386 s, 90.3 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:51:29,882::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:51:29,882::task::595::Storage.TaskManager.Task::(_updateState) Task=`051cc165-f4f8-491b-b59f-7077d63750a0`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:51:29,883::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:51:29,894::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:51:29,895::task::1191::Storage.TaskManager.Task::(prepare) Task=`051cc165-f4f8-491b-b59f-7077d63750a0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:51:29,895::task::595::Storage.TaskManager.Task::(_updateState) Task=`051cc165-f4f8-491b-b59f-7077d63750a0`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:51:29,895::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:51:29,895::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:51:29,895::task::993::Storage.TaskManager.Task::(_decref) Task=`051cc165-f4f8-491b-b59f-7077d63750a0`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:51:29,925::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:51:29,926::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9260377-2cca-40e7-bbef-c3df7f450ac8`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:51:29,926::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:51:29,926::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`5a74d127-5faa-4111-9861-4d259ec857ed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:51:29,926::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:51:29,926::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:51:29,926::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`5a74d127-5faa-4111-9861-4d259ec857ed`::Granted request >Thread-38::DEBUG::2014-09-16 10:51:29,927::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d9260377-2cca-40e7-bbef-c3df7f450ac8`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:51:29,927::task::993::Storage.TaskManager.Task::(_decref) Task=`d9260377-2cca-40e7-bbef-c3df7f450ac8`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:51:29,939::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:51:29,939::task::1191::Storage.TaskManager.Task::(prepare) Task=`d9260377-2cca-40e7-bbef-c3df7f450ac8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:51:29,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9260377-2cca-40e7-bbef-c3df7f450ac8`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:51:29,939::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:51:29,939::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:51:29,939::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:51:29,939::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:51:29,939::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:51:29,939::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:51:29,940::task::993::Storage.TaskManager.Task::(_decref) Task=`d9260377-2cca-40e7-bbef-c3df7f450ac8`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:51:31,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:31,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113379 s, 90.3 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:51:33,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:33,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114567 s, 89.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:51:35,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:35,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112938 s, 90.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:51:37,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:37,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113618 s, 90.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:51:38,679::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:38,679::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:38,679::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:38,679::__init__::232::IOProcess::(_processLogs) (41368) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:38,679::__init__::232::IOProcess::(_processLogs) (41368) Queuing response >Thread-47::DEBUG::2014-09-16 10:51:38,680::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:51:38,685::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000282979 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:51:38,686::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:38,686::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:38,686::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:38,686::__init__::232::IOProcess::(_processLogs) (41369) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:38,686::__init__::232::IOProcess::(_processLogs) (41369) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:38,718::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:38,718::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:38,718::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:38,718::__init__::232::IOProcess::(_processLogs) (41370) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:38,718::__init__::232::IOProcess::(_processLogs) (41370) Queuing response >Thread-21::DEBUG::2014-09-16 10:51:38,719::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:51:38,724::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000320203 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:51:38,725::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:38,725::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:38,725::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:38,725::__init__::232::IOProcess::(_processLogs) (41371) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:38,725::__init__::232::IOProcess::(_processLogs) (41371) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:38,726::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:38,726::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:38,726::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:38,726::__init__::232::IOProcess::(_processLogs) (41372) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:38,727::__init__::232::IOProcess::(_processLogs) (41372) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:38,727::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:38,727::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:38,727::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:38,727::__init__::232::IOProcess::(_processLogs) (41373) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:38,727::__init__::232::IOProcess::(_processLogs) (41373) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:38,728::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:38,728::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:38,728::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:38,728::__init__::232::IOProcess::(_processLogs) (41374) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:38,728::__init__::232::IOProcess::(_processLogs) (41374) Queuing response >Dummy-37::DEBUG::2014-09-16 10:51:39,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:39,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113147 s, 90.5 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:51:40,168::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:51:40,169::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b405569-5aad-4c48-a212-d889b40b0527`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:51:40,169::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:51:40,180::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:51:40,180::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b405569-5aad-4c48-a212-d889b40b0527`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:51:40,180::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b405569-5aad-4c48-a212-d889b40b0527`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:51:40,180::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:51:40,180::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:51:40,180::task::993::Storage.TaskManager.Task::(_decref) Task=`8b405569-5aad-4c48-a212-d889b40b0527`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:51:40,217::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:51:40,217::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3cf5d27-85a6-4b8d-a499-452f6d819616`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:51:40,217::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:51:40,217::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`45e31160-9525-436e-b1c8-6561289bf8f4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:51:40,218::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:51:40,218::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:51:40,218::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`45e31160-9525-436e-b1c8-6561289bf8f4`::Granted request >Thread-38::DEBUG::2014-09-16 10:51:40,218::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e3cf5d27-85a6-4b8d-a499-452f6d819616`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:51:40,218::task::993::Storage.TaskManager.Task::(_decref) Task=`e3cf5d27-85a6-4b8d-a499-452f6d819616`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:51:40,230::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:51:40,230::task::1191::Storage.TaskManager.Task::(prepare) Task=`e3cf5d27-85a6-4b8d-a499-452f6d819616`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:51:40,230::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3cf5d27-85a6-4b8d-a499-452f6d819616`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:51:40,230::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:51:40,230::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:51:40,231::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:51:40,231::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:51:40,231::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:51:40,231::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:51:40,231::task::993::Storage.TaskManager.Task::(_decref) Task=`e3cf5d27-85a6-4b8d-a499-452f6d819616`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:51:41,112::task::595::Storage.TaskManager.Task::(_updateState) Task=`e11a423c-8eca-4356-bad4-3fff267d3b37`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:51:41,112::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:51:41,112::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000282979', 'lastCheck': '2.4', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320203', 'lastCheck': '2.4', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:51:41,112::task::1191::Storage.TaskManager.Task::(prepare) Task=`e11a423c-8eca-4356-bad4-3fff267d3b37`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000282979', 'lastCheck': '2.4', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320203', 'lastCheck': '2.4', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:51:41,112::task::595::Storage.TaskManager.Task::(_updateState) Task=`e11a423c-8eca-4356-bad4-3fff267d3b37`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:51:41,112::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:51:41,113::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:51:41,113::task::993::Storage.TaskManager.Task::(_decref) Task=`e11a423c-8eca-4356-bad4-3fff267d3b37`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:51:41,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:41,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113295 s, 90.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:51:43,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:43,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113355 s, 90.3 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:51:45,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:45,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113368 s, 90.3 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:51:47,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:47,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112915 s, 90.7 MB/s\n'; <rc> = 0 >Thread-47::DEBUG::2014-09-16 10:51:48,687::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 97e2f375-6db7-43a3-81ad-ebbb94f94408 >Thread-14::DEBUG::2014-09-16 10:51:48,688::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:48,689::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:48,689::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:48,689::__init__::232::IOProcess::(_processLogs) (41375) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:51:48,689::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:48,689::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:48,689::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:48,689::__init__::232::IOProcess::(_processLogs) (41376) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:51:48,689::__init__::232::IOProcess::(_processLogs) (41375) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:48,690::__init__::232::IOProcess::(_processLogs) (41376) Queuing response >Thread-47::DEBUG::2014-09-16 10:51:48,692::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408 >Thread-14::DEBUG::2014-09-16 10:51:48,692::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:48,692::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:48,692::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:48,692::__init__::232::IOProcess::(_processLogs) (41377) Got request for method 'touch' >Thread-14::DEBUG::2014-09-16 10:51:48,693::__init__::232::IOProcess::(_processLogs) (41377) Queuing response >Thread-47::DEBUG::2014-09-16 10:51:48,694::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14::DEBUG::2014-09-16 10:51:48,694::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:48,694::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:48,694::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:48,694::__init__::232::IOProcess::(_processLogs) (41378) Got request for method 'readfile' >Thread-14::DEBUG::2014-09-16 10:51:48,695::__init__::232::IOProcess::(_processLogs) (41378) Queuing response >Thread-47::DEBUG::2014-09-16 10:51:48,695::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=da06caa7-b08d-4685-b49c-84565c268648', 'REMOTE_PATH=10.34.63.199:/cmg02', 'ROLE=Regular', 'SDUUID=97e2f375-6db7-43a3-81ad-ebbb94f94408', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=51581838ac1d2d1538de639f6a518c57b7d75e58'] >Thread-14::DEBUG::2014-09-16 10:51:48,696::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:48,696::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:48,696::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:48,696::__init__::232::IOProcess::(_processLogs) (41379) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:48,696::__init__::232::IOProcess::(_processLogs) (41379) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:48,696::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:48,696::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:48,697::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:48,697::__init__::232::IOProcess::(_processLogs) (41380) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:51:48,697::__init__::232::IOProcess::(_processLogs) (41380) Queuing response >Thread-47::DEBUG::2014-09-16 10:51:48,697::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-47::INFO::2014-09-16 10:51:48,698::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 97e2f375-6db7-43a3-81ad-ebbb94f94408_imageNS already registered >Thread-47::INFO::2014-09-16 10:51:48,698::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 97e2f375-6db7-43a3-81ad-ebbb94f94408_volumeNS already registered >Thread-14::DEBUG::2014-09-16 10:51:48,698::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:48,698::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:48,698::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:48,698::__init__::232::IOProcess::(_processLogs) (41381) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:48,698::__init__::232::IOProcess::(_processLogs) (41381) Queuing response >Thread-47::DEBUG::2014-09-16 10:51:48,699::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:51:48,704::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000316431 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:51:48,705::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:48,705::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:48,705::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:48,705::__init__::232::IOProcess::(_processLogs) (41382) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:48,705::__init__::232::IOProcess::(_processLogs) (41382) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:48,729::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:48,729::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:48,729::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:48,729::__init__::232::IOProcess::(_processLogs) (41383) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:48,729::__init__::232::IOProcess::(_processLogs) (41383) Queuing response >Thread-21::DEBUG::2014-09-16 10:51:48,730::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:51:48,735::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000341009 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:51:48,736::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:48,736::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:48,736::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:48,736::__init__::232::IOProcess::(_processLogs) (41384) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:48,736::__init__::232::IOProcess::(_processLogs) (41384) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:48,737::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:48,737::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:48,737::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:48,737::__init__::232::IOProcess::(_processLogs) (41385) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:48,737::__init__::232::IOProcess::(_processLogs) (41385) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:48,738::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:48,738::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:48,738::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:48,738::__init__::232::IOProcess::(_processLogs) (41386) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:48,738::__init__::232::IOProcess::(_processLogs) (41386) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:48,739::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:48,739::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:48,739::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:48,739::__init__::232::IOProcess::(_processLogs) (41387) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:48,739::__init__::232::IOProcess::(_processLogs) (41387) Queuing response >Dummy-37::DEBUG::2014-09-16 10:51:49,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:49,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114211 s, 89.7 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:51:50,585::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:51:50,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`f04303f0-1bf2-45c6-8275-6720fc45c824`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:51:50,585::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:51:50,596::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:51:50,596::task::1191::Storage.TaskManager.Task::(prepare) Task=`f04303f0-1bf2-45c6-8275-6720fc45c824`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:51:50,596::task::595::Storage.TaskManager.Task::(_updateState) Task=`f04303f0-1bf2-45c6-8275-6720fc45c824`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:51:50,597::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:51:50,597::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:51:50,597::task::993::Storage.TaskManager.Task::(_decref) Task=`f04303f0-1bf2-45c6-8275-6720fc45c824`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:51:50,632::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:51:50,632::task::595::Storage.TaskManager.Task::(_updateState) Task=`42326fe9-8601-4764-8341-5c8923612d7e`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:51:50,632::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:51:50,632::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`9afb42d3-5d14-4f4e-acf6-fc70f227f46b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:51:50,632::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:51:50,632::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:51:50,632::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`9afb42d3-5d14-4f4e-acf6-fc70f227f46b`::Granted request >Thread-38::DEBUG::2014-09-16 10:51:50,633::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`42326fe9-8601-4764-8341-5c8923612d7e`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:51:50,633::task::993::Storage.TaskManager.Task::(_decref) Task=`42326fe9-8601-4764-8341-5c8923612d7e`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:51:50,646::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:51:50,646::task::1191::Storage.TaskManager.Task::(prepare) Task=`42326fe9-8601-4764-8341-5c8923612d7e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:51:50,647::task::595::Storage.TaskManager.Task::(_updateState) Task=`42326fe9-8601-4764-8341-5c8923612d7e`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:51:50,647::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:51:50,647::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:51:50,647::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:51:50,647::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:51:50,647::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:51:50,647::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:51:50,647::task::993::Storage.TaskManager.Task::(_decref) Task=`42326fe9-8601-4764-8341-5c8923612d7e`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:51:51,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:52,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113037 s, 90.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:51:54,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:55,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.1054 s, 926 kB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:51:57,010::task::595::Storage.TaskManager.Task::(_updateState) Task=`d08be588-f528-4841-b8f9-70309a143348`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:51:57,010::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:51:57,010::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000316431', 'lastCheck': '8.3', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341009', 'lastCheck': '8.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:51:57,010::task::1191::Storage.TaskManager.Task::(prepare) Task=`d08be588-f528-4841-b8f9-70309a143348`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000316431', 'lastCheck': '8.3', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341009', 'lastCheck': '8.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:51:57,011::task::595::Storage.TaskManager.Task::(_updateState) Task=`d08be588-f528-4841-b8f9-70309a143348`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:51:57,011::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:51:57,011::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:51:57,011::task::993::Storage.TaskManager.Task::(_decref) Task=`d08be588-f528-4841-b8f9-70309a143348`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:51:57,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:57,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113971 s, 89.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:51:58,707::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:58,707::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:58,707::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:58,707::__init__::232::IOProcess::(_processLogs) (41388) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:58,707::__init__::232::IOProcess::(_processLogs) (41388) Queuing response >Thread-47::DEBUG::2014-09-16 10:51:58,708::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:51:58,713::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000320515 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:51:58,714::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:58,714::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:58,714::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:58,714::__init__::232::IOProcess::(_processLogs) (41389) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:58,714::__init__::232::IOProcess::(_processLogs) (41389) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:58,740::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:58,740::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:58,740::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:58,740::__init__::232::IOProcess::(_processLogs) (41390) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:58,740::__init__::232::IOProcess::(_processLogs) (41390) Queuing response >Thread-21::DEBUG::2014-09-16 10:51:58,741::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:51:58,746::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000306838 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:51:58,747::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:58,747::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:58,747::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:58,747::__init__::232::IOProcess::(_processLogs) (41391) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:51:58,747::__init__::232::IOProcess::(_processLogs) (41391) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:58,748::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:58,748::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:58,748::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:58,748::__init__::232::IOProcess::(_processLogs) (41392) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:58,748::__init__::232::IOProcess::(_processLogs) (41392) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:58,749::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:58,749::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:58,749::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:58,749::__init__::232::IOProcess::(_processLogs) (41393) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:58,749::__init__::232::IOProcess::(_processLogs) (41393) Queuing response >Thread-14::DEBUG::2014-09-16 10:51:58,750::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:51:58,750::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:51:58,750::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:51:58,750::__init__::232::IOProcess::(_processLogs) (41394) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:51:58,750::__init__::232::IOProcess::(_processLogs) (41394) Queuing response >Dummy-37::DEBUG::2014-09-16 10:51:59,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:51:59,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0111895 s, 91.5 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:52:00,829::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:52:00,829::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fa12055-5029-4c4a-967a-2a7c07d987c7`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:52:00,829::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:52:00,841::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:52:00,841::task::1191::Storage.TaskManager.Task::(prepare) Task=`1fa12055-5029-4c4a-967a-2a7c07d987c7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:52:00,841::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fa12055-5029-4c4a-967a-2a7c07d987c7`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:52:00,841::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:52:00,841::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:52:00,841::task::993::Storage.TaskManager.Task::(_decref) Task=`1fa12055-5029-4c4a-967a-2a7c07d987c7`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:52:00,872::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:52:00,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`10a44908-4c10-4f9c-a23f-ac7f533a7df8`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:52:00,872::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:52:00,873::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`fa5a197d-d731-4960-b6c5-6f2c7e508af2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:52:00,873::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:52:00,874::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:52:00,874::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`fa5a197d-d731-4960-b6c5-6f2c7e508af2`::Granted request >Thread-38::DEBUG::2014-09-16 10:52:00,874::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`10a44908-4c10-4f9c-a23f-ac7f533a7df8`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:52:00,874::task::993::Storage.TaskManager.Task::(_decref) Task=`10a44908-4c10-4f9c-a23f-ac7f533a7df8`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:52:00,886::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:52:00,886::task::1191::Storage.TaskManager.Task::(prepare) Task=`10a44908-4c10-4f9c-a23f-ac7f533a7df8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:52:00,886::task::595::Storage.TaskManager.Task::(_updateState) Task=`10a44908-4c10-4f9c-a23f-ac7f533a7df8`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:52:00,886::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:52:00,886::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:52:00,886::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:52:00,887::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:52:00,887::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:52:00,887::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:52:00,887::task::993::Storage.TaskManager.Task::(_decref) Task=`10a44908-4c10-4f9c-a23f-ac7f533a7df8`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:52:01,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:01,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120913 s, 84.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:52:03,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:03,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113621 s, 90.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:52:05,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:05,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112414 s, 91.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:52:07,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:07,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113784 s, 90.0 MB/s\n'; <rc> = 0 >Thread-38::DEBUG::2014-09-16 10:52:07,460::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:52:07,461::task::595::Storage.TaskManager.Task::(_updateState) Task=`acd25963-14c9-4832-a8b8-576b52e7a735`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:52:07,461::logUtils::44::dispatcher::(wrapper) Run and protect: getVmsInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', sdUUID='97e2f375-6db7-43a3-81ad-ebbb94f94408', vmList=[], options=None) >Thread-38::DEBUG::2014-09-16 10:52:07,463::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408`ReqID=`93ac9ca8-c6c3-4f50-8778-420fe4a5f09d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1416' at 'getVmsInfo' >Thread-38::DEBUG::2014-09-16 10:52:07,463::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:52:07,464::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:52:07,464::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408`ReqID=`93ac9ca8-c6c3-4f50-8778-420fe4a5f09d`::Granted request >Thread-38::DEBUG::2014-09-16 10:52:07,465::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`acd25963-14c9-4832-a8b8-576b52e7a735`::_resourcesAcquired: Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408 (shared) >Thread-38::DEBUG::2014-09-16 10:52:07,465::task::993::Storage.TaskManager.Task::(_decref) Task=`acd25963-14c9-4832-a8b8-576b52e7a735`::ref 1 aborting False >Thread-14::DEBUG::2014-09-16 10:52:07,467::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:07,468::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:07,468::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:07,469::__init__::232::IOProcess::(_processLogs) (41395) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:52:07,469::__init__::232::IOProcess::(_processLogs) (41395) Queuing response >Thread-38::INFO::2014-09-16 10:52:07,471::sd::609::Storage.StorageDomain::(getVMsList) vmList=[u'8336006d-108b-4baa-a383-8db50c8550b3', u'c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76', u'd647f1f6-8517-456d-ad3f-3bc7f997a48b'] >Thread-38::INFO::2014-09-16 10:52:07,472::sd::626::Storage.StorageDomain::(getVMsInfo) vmList=[u'8336006d-108b-4baa-a383-8db50c8550b3', u'c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76', u'd647f1f6-8517-456d-ad3f-3bc7f997a48b'] >Thread-38::INFO::2014-09-16 10:52:07,475::logUtils::47::dispatcher::(wrapper) Run and protect: getVmsInfo, Return response: {'vmlist': {u'c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.5.0.0"><References><File ovf:href="b3abd738-0771-4993-b9c6-b2c410cba99f/e0fad42b-ca97-416c-9867-03fd34939346" ovf:id="e0fad42b-ca97-416c-9867-03fd34939346" ovf:size="5368709120" ovf:description=""/><Nic ovf:id="77794904-2537-4bd6-9247-76472be9e698"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="e0fad42b-ca97-416c-9867-03fd34939346" ovf:size="5" ovf:actual_size="1" ovf:vm_snapshot_id="608a5bdc-e5de-4407-8f39-f92b2a687071" ovf:parentRef="" ovf:fileRef="b3abd738-0771-4993-b9c6-b2c410cba99f/e0fad42b-ca97-416c-9867-03fd34939346" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Comment></Comment><CreationDate>2014/09/15 19:33:13</CreationDate><ExportDate>2014/09/15 19:45:20</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone>Etc/GMT</TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><IsBootMenuEnabled>false</IsBootMenuEnabled><IsSpiceFileTransferEnabled>true</IsSpiceFileTransferEnabled><IsSpiceCopyPasteEnabled>true</IsSpiceCopyPasteEnabled><Name>template_01</Name><TemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</TemplateId><Origin>3</Origin><default_display_type>1</default_display_type><IsDisabled>false</IsDisabled><TrustedService>false</TrustedService><TemplateType>TEMPLATE</TemplateType><BaseTemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</BaseTemplateId><TemplateVersionNumber>1</TemplateVersionNumber><TemplateVersionName>base version</TemplateVersionName><AutoStartup>false</AutoStartup><Section ovf:id="c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.5.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_Disk1</rasd:Caption><rasd:InstanceId>e0fad42b-ca97-416c-9867-03fd34939346</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>b3abd738-0771-4993-b9c6-b2c410cba99f/e0fad42b-ca97-416c-9867-03fd34939346</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>b66bf4f1-94ad-487c-aa76-34598a679d7b</rasd:StorageId><rasd:StoragePoolId>da06caa7-b08d-4685-b49c-84565c268648</rasd:StoragePoolId><rasd:CreationDate>2014/09/15 19:33:13</rasd:CreationDate><rasd:LastModified>1970/01/01 00:00:00</rasd:LastModified><Type>disk</Type><Device>disk</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}</rasd:Address><BootOrder>1</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-disk0</Alias></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>77794904-2537-4bd6-9247-76472be9e698</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>net0</Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>c4b4f86b-d98d-4adc-9d8c-707af5ff455f</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x02, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>video0</Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>766a0087-5feb-4ff0-840f-6642ff47cf45</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>5001a584-b2a9-4d65-a82b-a7b46dde46c3</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=2, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel1</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>2959307c-1338-418d-b9a6-0cebd85043e2</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=1, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>64622ab6-9359-4c37-9733-fb5aeda96b5d</rasd:InstanceId><Type>controller</Type><Device>usb</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>usb0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>801c5c9a-9771-4e5f-ba30-e228b217b9bb</rasd:InstanceId><Type>channel</Type><Device>spicevmc</Device><rasd:Address>{port=3, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel2</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>a95f54f3-cb96-4fe0-a1d0-56b2b5dced07</rasd:InstanceId><Type>controller</Type><Device>ide</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>ide0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>6554c255-573d-4933-9f62-2aaac2b84bb9</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>balloon0</Alias><SpecParams><model>virtio</model></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>cc698b3f-460e-420c-8ea2-179b3ea06665</rasd:InstanceId><Type>controller</Type><Device>virtio-serial</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-serial0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>d2e18bf0-2cd7-422c-ac6f-2526741ce00d</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>scsi0</Alias></Item></Section></Content></ovf:Envelope>', u'd647f1f6-8517-456d-ad3f-3bc7f997a48b': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.5.0.0"><References><File ovf:href="77bd3941-a78c-4928-8654-47c360ed4a11/8b3284b5-81f1-42b0-8a18-a9bd4eecfc81" ovf:id="8b3284b5-81f1-42b0-8a18-a9bd4eecfc81" ovf:size="5368709120" ovf:description="Active VM"/><Nic ovf:id="05a2b104-f182-4a77-b550-50a7c04a7e66"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="8b3284b5-81f1-42b0-8a18-a9bd4eecfc81" ovf:size="5" ovf:actual_size="0" ovf:vm_snapshot_id="203b7c45-1004-42bb-af21-844c22b1b80f" ovf:parentRef="" ovf:fileRef="77bd3941-a78c-4928-8654-47c360ed4a11/8b3284b5-81f1-42b0-8a18-a9bd4eecfc81" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Comment></Comment><CreationDate>2014/09/15 19:38:24</CreationDate><ExportDate>2014/09/15 19:47:23</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone>Etc/GMT</TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><IsBootMenuEnabled>false</IsBootMenuEnabled><IsSpiceFileTransferEnabled>true</IsSpiceFileTransferEnabled><IsSpiceCopyPasteEnabled>true</IsSpiceCopyPasteEnabled><Name>vm_thin</Name><TemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</TemplateId><TemplateName>template_01</TemplateName><IsInitilized>false</IsInitilized><Origin>3</Origin><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</OriginalTemplateId><OriginalTemplateName>template_01</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="d647f1f6-8517-456d-ad3f-3bc7f997a48b" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.5.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_Disk1</rasd:Caption><rasd:InstanceId>8b3284b5-81f1-42b0-8a18-a9bd4eecfc81</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>77bd3941-a78c-4928-8654-47c360ed4a11/8b3284b5-81f1-42b0-8a18-a9bd4eecfc81</rasd:HostResource><rasd:Parent>e0fad42b-ca97-416c-9867-03fd34939346</rasd:Parent><rasd:Template>e0fad42b-ca97-416c-9867-03fd34939346</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>b66bf4f1-94ad-487c-aa76-34598a679d7b</rasd:StorageId><rasd:StoragePoolId>da06caa7-b08d-4685-b49c-84565c268648</rasd:StoragePoolId><rasd:CreationDate>2014/09/15 19:38:25</rasd:CreationDate><rasd:LastModified>1970/01/01 00:00:00</rasd:LastModified><rasd:last_modified_date>2014/09/15 19:47:23</rasd:last_modified_date><Type>disk</Type><Device>disk</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}</rasd:Address><BootOrder>1</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-disk0</Alias></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>05a2b104-f182-4a77-b550-50a7c04a7e66</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:1b:81:01</rasd:MACAddress><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>net0</Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>897d3137-1064-45b9-84b7-273fb7d53292</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>404558d5-db3d-4715-b620-e914e5ffee3e</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>9cd3eac9-3e32-445c-bdff-d750de625a2c</rasd:InstanceId><Type>channel</Type><Device>spicevmc</Device><rasd:Address>{port=3, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel2</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>497fad76-9e29-4177-bf7a-c12b984caff4</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=1, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>5da0f131-81e9-4769-bdff-9dfc9c452c3d</rasd:InstanceId><Type>controller</Type><Device>usb</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>usb0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>6c4f4e12-ef3f-4794-9378-61bdcb8ab133</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=2, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel1</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>7dc3ea9b-4227-4be6-8156-2d07f1b4f034</rasd:InstanceId><Type>controller</Type><Device>ide</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>ide0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>0e11ee04-add0-4e5a-aa0d-a1a93531696b</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>scsi0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>3180e61e-cdac-46ba-b9a5-aa7e36e011ad</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>balloon0</Alias><SpecParams><model>virtio</model></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>ec701dae-60b5-4021-b5da-ab5b43bc407a</rasd:InstanceId><Type>controller</Type><Device>virtio-serial</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-serial0</Alias></Item></Section><Section xsi:type="ovf:SnapshotsSection_Type"><Snapshot ovf:id="203b7c45-1004-42bb-af21-844c22b1b80f"><Type>ACTIVE</Type><Description>Active VM</Description><CreationDate>2014/09/15 19:38:24</CreationDate></Snapshot></Section></Content></ovf:Envelope>', u'8336006d-108b-4baa-a383-8db50c8550b3': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.5.0.0"><References><File ovf:href="eddf19a5-5b3b-47f4-b3c0-1e5010d2b010/cdf97095-e01f-4954-8f18-d47b23db3b8e" ovf:id="cdf97095-e01f-4954-8f18-d47b23db3b8e" ovf:size="5368709120" ovf:description="Active VM"/><Nic ovf:id="371d03af-d74e-46c2-aae7-adbea123a19c"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="cdf97095-e01f-4954-8f18-d47b23db3b8e" ovf:size="5" ovf:actual_size="1" ovf:vm_snapshot_id="3bd5af76-49b6-4eea-aad4-7ffdc5e86433" ovf:parentRef="" ovf:fileRef="eddf19a5-5b3b-47f4-b3c0-1e5010d2b010/cdf97095-e01f-4954-8f18-d47b23db3b8e" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Comment></Comment><CreationDate>2014/09/15 19:39:02</CreationDate><ExportDate>2014/09/15 19:51:05</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone>Etc/GMT</TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><IsBootMenuEnabled>false</IsBootMenuEnabled><IsSpiceFileTransferEnabled>true</IsSpiceFileTransferEnabled><IsSpiceCopyPasteEnabled>true</IsSpiceCopyPasteEnabled><Name>vm_clone</Name><TemplateId>00000000-0000-0000-0000-000000000000</TemplateId><TemplateName>Blank</TemplateName><IsInitilized>false</IsInitilized><Origin>3</Origin><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</OriginalTemplateId><OriginalTemplateName>template_01</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="8336006d-108b-4baa-a383-8db50c8550b3" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.5.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_Disk1</rasd:Caption><rasd:InstanceId>cdf97095-e01f-4954-8f18-d47b23db3b8e</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>eddf19a5-5b3b-47f4-b3c0-1e5010d2b010/cdf97095-e01f-4954-8f18-d47b23db3b8e</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>b66bf4f1-94ad-487c-aa76-34598a679d7b</rasd:StorageId><rasd:StoragePoolId>da06caa7-b08d-4685-b49c-84565c268648</rasd:StoragePoolId><rasd:CreationDate>2014/09/15 19:39:03</rasd:CreationDate><rasd:LastModified>1970/01/01 00:00:00</rasd:LastModified><rasd:last_modified_date>2014/09/15 19:51:05</rasd:last_modified_date><Type>disk</Type><Device>disk</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}</rasd:Address><BootOrder>1</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-disk0</Alias></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>371d03af-d74e-46c2-aae7-adbea123a19c</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:1b:81:02</rasd:MACAddress><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>net0</Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>154e50e8-0178-402d-a317-480c7dcdcb4b</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>85424e3d-0d99-4418-9b34-78cadb583162</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>d73a0de4-bb99-4132-b336-8988d43218f9</rasd:InstanceId><Type>channel</Type><Device>spicevmc</Device><rasd:Address>{port=3, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel2</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>ddd2e0a1-332e-4141-a7de-f862bd058c3e</rasd:InstanceId><Type>controller</Type><Device>usb</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>usb0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>f25258af-d547-4d74-b9df-ed00cfa11228</rasd:InstanceId><Type>controller</Type><Device>ide</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>ide0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>0c5506e1-af6d-484a-88c1-f51799206c7e</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=2, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel1</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>7fe9e7a5-bb21-4138-841a-5337c1535778</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=1, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>8e6e5e40-5c2e-45fd-b6b6-002a6d06fa1e</rasd:InstanceId><Type>controller</Type><Device>virtio-serial</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-serial0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>b7a8fae6-c4da-41b8-9d23-7605cce4d1b5</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>scsi0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>27a117d2-ab3c-4673-9b5d-d198c995a1d6</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>balloon0</Alias><SpecParams><model>virtio</model></SpecParams></Item></Section><Section xsi:type="ovf:SnapshotsSection_Type"><Snapshot ovf:id="3bd5af76-49b6-4eea-aad4-7ffdc5e86433"><Type>ACTIVE</Type><Description>Active VM</Description><CreationDate>2014/09/15 19:39:02</CreationDate></Snapshot></Section></Content></ovf:Envelope>'}} >Thread-38::DEBUG::2014-09-16 10:52:07,476::task::1191::Storage.TaskManager.Task::(prepare) Task=`acd25963-14c9-4832-a8b8-576b52e7a735`::finished: {'vmlist': {u'c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.5.0.0"><References><File ovf:href="b3abd738-0771-4993-b9c6-b2c410cba99f/e0fad42b-ca97-416c-9867-03fd34939346" ovf:id="e0fad42b-ca97-416c-9867-03fd34939346" ovf:size="5368709120" ovf:description=""/><Nic ovf:id="77794904-2537-4bd6-9247-76472be9e698"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="e0fad42b-ca97-416c-9867-03fd34939346" ovf:size="5" ovf:actual_size="1" ovf:vm_snapshot_id="608a5bdc-e5de-4407-8f39-f92b2a687071" ovf:parentRef="" ovf:fileRef="b3abd738-0771-4993-b9c6-b2c410cba99f/e0fad42b-ca97-416c-9867-03fd34939346" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Comment></Comment><CreationDate>2014/09/15 19:33:13</CreationDate><ExportDate>2014/09/15 19:45:20</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone>Etc/GMT</TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><IsBootMenuEnabled>false</IsBootMenuEnabled><IsSpiceFileTransferEnabled>true</IsSpiceFileTransferEnabled><IsSpiceCopyPasteEnabled>true</IsSpiceCopyPasteEnabled><Name>template_01</Name><TemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</TemplateId><Origin>3</Origin><default_display_type>1</default_display_type><IsDisabled>false</IsDisabled><TrustedService>false</TrustedService><TemplateType>TEMPLATE</TemplateType><BaseTemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</BaseTemplateId><TemplateVersionNumber>1</TemplateVersionNumber><TemplateVersionName>base version</TemplateVersionName><AutoStartup>false</AutoStartup><Section ovf:id="c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.5.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_Disk1</rasd:Caption><rasd:InstanceId>e0fad42b-ca97-416c-9867-03fd34939346</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>b3abd738-0771-4993-b9c6-b2c410cba99f/e0fad42b-ca97-416c-9867-03fd34939346</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>b66bf4f1-94ad-487c-aa76-34598a679d7b</rasd:StorageId><rasd:StoragePoolId>da06caa7-b08d-4685-b49c-84565c268648</rasd:StoragePoolId><rasd:CreationDate>2014/09/15 19:33:13</rasd:CreationDate><rasd:LastModified>1970/01/01 00:00:00</rasd:LastModified><Type>disk</Type><Device>disk</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}</rasd:Address><BootOrder>1</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-disk0</Alias></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>77794904-2537-4bd6-9247-76472be9e698</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>net0</Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>c4b4f86b-d98d-4adc-9d8c-707af5ff455f</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x02, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>video0</Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>766a0087-5feb-4ff0-840f-6642ff47cf45</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>5001a584-b2a9-4d65-a82b-a7b46dde46c3</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=2, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel1</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>2959307c-1338-418d-b9a6-0cebd85043e2</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=1, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>64622ab6-9359-4c37-9733-fb5aeda96b5d</rasd:InstanceId><Type>controller</Type><Device>usb</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>usb0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>801c5c9a-9771-4e5f-ba30-e228b217b9bb</rasd:InstanceId><Type>channel</Type><Device>spicevmc</Device><rasd:Address>{port=3, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel2</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>a95f54f3-cb96-4fe0-a1d0-56b2b5dced07</rasd:InstanceId><Type>controller</Type><Device>ide</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>ide0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>6554c255-573d-4933-9f62-2aaac2b84bb9</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>balloon0</Alias><SpecParams><model>virtio</model></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>cc698b3f-460e-420c-8ea2-179b3ea06665</rasd:InstanceId><Type>controller</Type><Device>virtio-serial</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-serial0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>d2e18bf0-2cd7-422c-ac6f-2526741ce00d</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>scsi0</Alias></Item></Section></Content></ovf:Envelope>', u'd647f1f6-8517-456d-ad3f-3bc7f997a48b': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.5.0.0"><References><File ovf:href="77bd3941-a78c-4928-8654-47c360ed4a11/8b3284b5-81f1-42b0-8a18-a9bd4eecfc81" ovf:id="8b3284b5-81f1-42b0-8a18-a9bd4eecfc81" ovf:size="5368709120" ovf:description="Active VM"/><Nic ovf:id="05a2b104-f182-4a77-b550-50a7c04a7e66"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="8b3284b5-81f1-42b0-8a18-a9bd4eecfc81" ovf:size="5" ovf:actual_size="0" ovf:vm_snapshot_id="203b7c45-1004-42bb-af21-844c22b1b80f" ovf:parentRef="" ovf:fileRef="77bd3941-a78c-4928-8654-47c360ed4a11/8b3284b5-81f1-42b0-8a18-a9bd4eecfc81" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Comment></Comment><CreationDate>2014/09/15 19:38:24</CreationDate><ExportDate>2014/09/15 19:47:23</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone>Etc/GMT</TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><IsBootMenuEnabled>false</IsBootMenuEnabled><IsSpiceFileTransferEnabled>true</IsSpiceFileTransferEnabled><IsSpiceCopyPasteEnabled>true</IsSpiceCopyPasteEnabled><Name>vm_thin</Name><TemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</TemplateId><TemplateName>template_01</TemplateName><IsInitilized>false</IsInitilized><Origin>3</Origin><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</OriginalTemplateId><OriginalTemplateName>template_01</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="d647f1f6-8517-456d-ad3f-3bc7f997a48b" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.5.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_Disk1</rasd:Caption><rasd:InstanceId>8b3284b5-81f1-42b0-8a18-a9bd4eecfc81</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>77bd3941-a78c-4928-8654-47c360ed4a11/8b3284b5-81f1-42b0-8a18-a9bd4eecfc81</rasd:HostResource><rasd:Parent>e0fad42b-ca97-416c-9867-03fd34939346</rasd:Parent><rasd:Template>e0fad42b-ca97-416c-9867-03fd34939346</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>b66bf4f1-94ad-487c-aa76-34598a679d7b</rasd:StorageId><rasd:StoragePoolId>da06caa7-b08d-4685-b49c-84565c268648</rasd:StoragePoolId><rasd:CreationDate>2014/09/15 19:38:25</rasd:CreationDate><rasd:LastModified>1970/01/01 00:00:00</rasd:LastModified><rasd:last_modified_date>2014/09/15 19:47:23</rasd:last_modified_date><Type>disk</Type><Device>disk</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}</rasd:Address><BootOrder>1</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-disk0</Alias></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>05a2b104-f182-4a77-b550-50a7c04a7e66</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:1b:81:01</rasd:MACAddress><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>net0</Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>897d3137-1064-45b9-84b7-273fb7d53292</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>404558d5-db3d-4715-b620-e914e5ffee3e</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>9cd3eac9-3e32-445c-bdff-d750de625a2c</rasd:InstanceId><Type>channel</Type><Device>spicevmc</Device><rasd:Address>{port=3, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel2</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>497fad76-9e29-4177-bf7a-c12b984caff4</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=1, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>5da0f131-81e9-4769-bdff-9dfc9c452c3d</rasd:InstanceId><Type>controller</Type><Device>usb</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>usb0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>6c4f4e12-ef3f-4794-9378-61bdcb8ab133</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=2, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel1</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>7dc3ea9b-4227-4be6-8156-2d07f1b4f034</rasd:InstanceId><Type>controller</Type><Device>ide</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>ide0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>0e11ee04-add0-4e5a-aa0d-a1a93531696b</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>scsi0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>3180e61e-cdac-46ba-b9a5-aa7e36e011ad</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>balloon0</Alias><SpecParams><model>virtio</model></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>ec701dae-60b5-4021-b5da-ab5b43bc407a</rasd:InstanceId><Type>controller</Type><Device>virtio-serial</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-serial0</Alias></Item></Section><Section xsi:type="ovf:SnapshotsSection_Type"><Snapshot ovf:id="203b7c45-1004-42bb-af21-844c22b1b80f"><Type>ACTIVE</Type><Description>Active VM</Description><CreationDate>2014/09/15 19:38:24</CreationDate></Snapshot></Section></Content></ovf:Envelope>', u'8336006d-108b-4baa-a383-8db50c8550b3': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.5.0.0"><References><File ovf:href="eddf19a5-5b3b-47f4-b3c0-1e5010d2b010/cdf97095-e01f-4954-8f18-d47b23db3b8e" ovf:id="cdf97095-e01f-4954-8f18-d47b23db3b8e" ovf:size="5368709120" ovf:description="Active VM"/><Nic ovf:id="371d03af-d74e-46c2-aae7-adbea123a19c"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="cdf97095-e01f-4954-8f18-d47b23db3b8e" ovf:size="5" ovf:actual_size="1" ovf:vm_snapshot_id="3bd5af76-49b6-4eea-aad4-7ffdc5e86433" ovf:parentRef="" ovf:fileRef="eddf19a5-5b3b-47f4-b3c0-1e5010d2b010/cdf97095-e01f-4954-8f18-d47b23db3b8e" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Comment></Comment><CreationDate>2014/09/15 19:39:02</CreationDate><ExportDate>2014/09/15 19:51:05</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone>Etc/GMT</TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><IsBootMenuEnabled>false</IsBootMenuEnabled><IsSpiceFileTransferEnabled>true</IsSpiceFileTransferEnabled><IsSpiceCopyPasteEnabled>true</IsSpiceCopyPasteEnabled><Name>vm_clone</Name><TemplateId>00000000-0000-0000-0000-000000000000</TemplateId><TemplateName>Blank</TemplateName><IsInitilized>false</IsInitilized><Origin>3</Origin><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</OriginalTemplateId><OriginalTemplateName>template_01</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="8336006d-108b-4baa-a383-8db50c8550b3" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.5.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_Disk1</rasd:Caption><rasd:InstanceId>cdf97095-e01f-4954-8f18-d47b23db3b8e</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>eddf19a5-5b3b-47f4-b3c0-1e5010d2b010/cdf97095-e01f-4954-8f18-d47b23db3b8e</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>b66bf4f1-94ad-487c-aa76-34598a679d7b</rasd:StorageId><rasd:StoragePoolId>da06caa7-b08d-4685-b49c-84565c268648</rasd:StoragePoolId><rasd:CreationDate>2014/09/15 19:39:03</rasd:CreationDate><rasd:LastModified>1970/01/01 00:00:00</rasd:LastModified><rasd:last_modified_date>2014/09/15 19:51:05</rasd:last_modified_date><Type>disk</Type><Device>disk</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}</rasd:Address><BootOrder>1</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-disk0</Alias></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>371d03af-d74e-46c2-aae7-adbea123a19c</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:1b:81:02</rasd:MACAddress><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>net0</Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>154e50e8-0178-402d-a317-480c7dcdcb4b</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>85424e3d-0d99-4418-9b34-78cadb583162</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>d73a0de4-bb99-4132-b336-8988d43218f9</rasd:InstanceId><Type>channel</Type><Device>spicevmc</Device><rasd:Address>{port=3, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel2</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>ddd2e0a1-332e-4141-a7de-f862bd058c3e</rasd:InstanceId><Type>controller</Type><Device>usb</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>usb0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>f25258af-d547-4d74-b9df-ed00cfa11228</rasd:InstanceId><Type>controller</Type><Device>ide</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>ide0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>0c5506e1-af6d-484a-88c1-f51799206c7e</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=2, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel1</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>7fe9e7a5-bb21-4138-841a-5337c1535778</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=1, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>8e6e5e40-5c2e-45fd-b6b6-002a6d06fa1e</rasd:InstanceId><Type>controller</Type><Device>virtio-serial</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-serial0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>b7a8fae6-c4da-41b8-9d23-7605cce4d1b5</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>scsi0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>27a117d2-ab3c-4673-9b5d-d198c995a1d6</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>balloon0</Alias><SpecParams><model>virtio</model></SpecParams></Item></Section><Section xsi:type="ovf:SnapshotsSection_Type"><Snapshot ovf:id="3bd5af76-49b6-4eea-aad4-7ffdc5e86433"><Type>ACTIVE</Type><Description>Active VM</Description><CreationDate>2014/09/15 19:39:02</CreationDate></Snapshot></Section></Content></ovf:Envelope>'}} >Thread-38::DEBUG::2014-09-16 10:52:07,476::task::595::Storage.TaskManager.Task::(_updateState) Task=`acd25963-14c9-4832-a8b8-576b52e7a735`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:52:07,477::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408': < ResourceRef 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:52:07,477::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:52:07,478::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408' >Thread-38::DEBUG::2014-09-16 10:52:07,478::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408' (0 active users) >Thread-38::DEBUG::2014-09-16 10:52:07,479::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:52:07,479::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408', Clearing records. >Thread-38::DEBUG::2014-09-16 10:52:07,480::task::993::Storage.TaskManager.Task::(_decref) Task=`acd25963-14c9-4832-a8b8-576b52e7a735`::ref 0 aborting False >Thread-14::DEBUG::2014-09-16 10:52:08,716::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:08,716::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:08,716::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:08,716::__init__::232::IOProcess::(_processLogs) (41396) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:08,716::__init__::232::IOProcess::(_processLogs) (41396) Queuing response >Thread-47::DEBUG::2014-09-16 10:52:08,717::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:52:08,722::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000299421 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:52:08,723::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:08,723::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:08,723::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:08,723::__init__::232::IOProcess::(_processLogs) (41397) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:08,723::__init__::232::IOProcess::(_processLogs) (41397) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:08,751::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:08,751::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:08,751::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:08,751::__init__::232::IOProcess::(_processLogs) (41398) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:08,751::__init__::232::IOProcess::(_processLogs) (41398) Queuing response >Thread-21::DEBUG::2014-09-16 10:52:08,752::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:52:08,757::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000322961 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:52:08,758::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:08,758::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:08,758::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:08,758::__init__::232::IOProcess::(_processLogs) (41399) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:08,758::__init__::232::IOProcess::(_processLogs) (41399) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:08,759::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:08,759::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:08,759::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:08,759::__init__::232::IOProcess::(_processLogs) (41400) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:08,760::__init__::232::IOProcess::(_processLogs) (41400) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:08,760::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:08,760::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:08,760::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:08,760::__init__::232::IOProcess::(_processLogs) (41401) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:08,760::__init__::232::IOProcess::(_processLogs) (41401) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:08,761::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:08,761::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:08,761::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:08,761::__init__::232::IOProcess::(_processLogs) (41402) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:08,761::__init__::232::IOProcess::(_processLogs) (41402) Queuing response >Dummy-37::DEBUG::2014-09-16 10:52:09,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:09,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112581 s, 91.0 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:52:11,084::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:52:11,085::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1bc5c83-7fce-4d82-baec-c47a08446331`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:52:11,085::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:52:11,096::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:52:11,096::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1bc5c83-7fce-4d82-baec-c47a08446331`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:52:11,096::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1bc5c83-7fce-4d82-baec-c47a08446331`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:52:11,096::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:52:11,096::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:52:11,096::task::993::Storage.TaskManager.Task::(_decref) Task=`e1bc5c83-7fce-4d82-baec-c47a08446331`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:52:11,126::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:52:11,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0f05378-50d0-4cfd-8a64-b34edfe327b7`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:52:11,126::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:52:11,126::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`0462b0d5-6b45-4fbd-8836-7e31a8ae9669`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:52:11,126::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:52:11,127::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:52:11,127::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`0462b0d5-6b45-4fbd-8836-7e31a8ae9669`::Granted request >Thread-38::DEBUG::2014-09-16 10:52:11,127::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b0f05378-50d0-4cfd-8a64-b34edfe327b7`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:52:11,127::task::993::Storage.TaskManager.Task::(_decref) Task=`b0f05378-50d0-4cfd-8a64-b34edfe327b7`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:52:11,139::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:52:11,139::task::1191::Storage.TaskManager.Task::(prepare) Task=`b0f05378-50d0-4cfd-8a64-b34edfe327b7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:52:11,139::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0f05378-50d0-4cfd-8a64-b34edfe327b7`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:52:11,139::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:52:11,139::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:52:11,140::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:52:11,140::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:52:11,140::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:52:11,140::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:52:11,140::task::993::Storage.TaskManager.Task::(_decref) Task=`b0f05378-50d0-4cfd-8a64-b34edfe327b7`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:52:11,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:11,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0111668 s, 91.7 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:52:12,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`88319c40-4fad-4f88-834b-81f084c750f5`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:52:12,643::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:52:12,643::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000299421', 'lastCheck': '3.9', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000322961', 'lastCheck': '3.9', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:52:12,643::task::1191::Storage.TaskManager.Task::(prepare) Task=`88319c40-4fad-4f88-834b-81f084c750f5`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000299421', 'lastCheck': '3.9', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000322961', 'lastCheck': '3.9', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:52:12,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`88319c40-4fad-4f88-834b-81f084c750f5`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:52:12,643::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:52:12,643::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:52:12,643::task::993::Storage.TaskManager.Task::(_decref) Task=`88319c40-4fad-4f88-834b-81f084c750f5`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:52:13,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:13,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011278 s, 90.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:52:15,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:15,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112283 s, 91.2 MB/s\n'; <rc> = 0 >Thread-38::DEBUG::2014-09-16 10:52:17,677::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:52:17,677::task::595::Storage.TaskManager.Task::(_updateState) Task=`19536d53-4661-47b4-9d09-5ceabc940463`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:52:17,677::logUtils::44::dispatcher::(wrapper) Run and protect: getVmsInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', sdUUID='97e2f375-6db7-43a3-81ad-ebbb94f94408', vmList=[], options=None) >Thread-38::DEBUG::2014-09-16 10:52:17,678::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408`ReqID=`3ec281b8-376a-4ec3-8a4f-9d874a52ca38`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1416' at 'getVmsInfo' >Thread-38::DEBUG::2014-09-16 10:52:17,678::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:52:17,678::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:52:17,678::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408`ReqID=`3ec281b8-376a-4ec3-8a4f-9d874a52ca38`::Granted request >Thread-38::DEBUG::2014-09-16 10:52:17,678::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`19536d53-4661-47b4-9d09-5ceabc940463`::_resourcesAcquired: Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408 (shared) >Thread-38::DEBUG::2014-09-16 10:52:17,678::task::993::Storage.TaskManager.Task::(_decref) Task=`19536d53-4661-47b4-9d09-5ceabc940463`::ref 1 aborting False >Thread-14::DEBUG::2014-09-16 10:52:17,679::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:17,679::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:17,679::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:17,679::__init__::232::IOProcess::(_processLogs) (41403) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:52:17,679::__init__::232::IOProcess::(_processLogs) (41403) Queuing response >Thread-38::INFO::2014-09-16 10:52:17,680::sd::609::Storage.StorageDomain::(getVMsList) vmList=[u'8336006d-108b-4baa-a383-8db50c8550b3', u'c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76', u'd647f1f6-8517-456d-ad3f-3bc7f997a48b'] >Thread-38::INFO::2014-09-16 10:52:17,680::sd::626::Storage.StorageDomain::(getVMsInfo) vmList=[u'8336006d-108b-4baa-a383-8db50c8550b3', u'c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76', u'd647f1f6-8517-456d-ad3f-3bc7f997a48b'] >Thread-38::INFO::2014-09-16 10:52:17,681::logUtils::47::dispatcher::(wrapper) Run and protect: getVmsInfo, Return response: {'vmlist': {u'c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.5.0.0"><References><File ovf:href="b3abd738-0771-4993-b9c6-b2c410cba99f/e0fad42b-ca97-416c-9867-03fd34939346" ovf:id="e0fad42b-ca97-416c-9867-03fd34939346" ovf:size="5368709120" ovf:description=""/><Nic ovf:id="77794904-2537-4bd6-9247-76472be9e698"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="e0fad42b-ca97-416c-9867-03fd34939346" ovf:size="5" ovf:actual_size="1" ovf:vm_snapshot_id="608a5bdc-e5de-4407-8f39-f92b2a687071" ovf:parentRef="" ovf:fileRef="b3abd738-0771-4993-b9c6-b2c410cba99f/e0fad42b-ca97-416c-9867-03fd34939346" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Comment></Comment><CreationDate>2014/09/15 19:33:13</CreationDate><ExportDate>2014/09/15 19:45:20</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone>Etc/GMT</TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><IsBootMenuEnabled>false</IsBootMenuEnabled><IsSpiceFileTransferEnabled>true</IsSpiceFileTransferEnabled><IsSpiceCopyPasteEnabled>true</IsSpiceCopyPasteEnabled><Name>template_01</Name><TemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</TemplateId><Origin>3</Origin><default_display_type>1</default_display_type><IsDisabled>false</IsDisabled><TrustedService>false</TrustedService><TemplateType>TEMPLATE</TemplateType><BaseTemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</BaseTemplateId><TemplateVersionNumber>1</TemplateVersionNumber><TemplateVersionName>base version</TemplateVersionName><AutoStartup>false</AutoStartup><Section ovf:id="c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.5.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_Disk1</rasd:Caption><rasd:InstanceId>e0fad42b-ca97-416c-9867-03fd34939346</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>b3abd738-0771-4993-b9c6-b2c410cba99f/e0fad42b-ca97-416c-9867-03fd34939346</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>b66bf4f1-94ad-487c-aa76-34598a679d7b</rasd:StorageId><rasd:StoragePoolId>da06caa7-b08d-4685-b49c-84565c268648</rasd:StoragePoolId><rasd:CreationDate>2014/09/15 19:33:13</rasd:CreationDate><rasd:LastModified>1970/01/01 00:00:00</rasd:LastModified><Type>disk</Type><Device>disk</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}</rasd:Address><BootOrder>1</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-disk0</Alias></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>77794904-2537-4bd6-9247-76472be9e698</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>net0</Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>c4b4f86b-d98d-4adc-9d8c-707af5ff455f</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x02, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>video0</Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>766a0087-5feb-4ff0-840f-6642ff47cf45</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>5001a584-b2a9-4d65-a82b-a7b46dde46c3</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=2, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel1</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>2959307c-1338-418d-b9a6-0cebd85043e2</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=1, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>64622ab6-9359-4c37-9733-fb5aeda96b5d</rasd:InstanceId><Type>controller</Type><Device>usb</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>usb0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>801c5c9a-9771-4e5f-ba30-e228b217b9bb</rasd:InstanceId><Type>channel</Type><Device>spicevmc</Device><rasd:Address>{port=3, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel2</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>a95f54f3-cb96-4fe0-a1d0-56b2b5dced07</rasd:InstanceId><Type>controller</Type><Device>ide</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>ide0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>6554c255-573d-4933-9f62-2aaac2b84bb9</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>balloon0</Alias><SpecParams><model>virtio</model></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>cc698b3f-460e-420c-8ea2-179b3ea06665</rasd:InstanceId><Type>controller</Type><Device>virtio-serial</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-serial0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>d2e18bf0-2cd7-422c-ac6f-2526741ce00d</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>scsi0</Alias></Item></Section></Content></ovf:Envelope>', u'd647f1f6-8517-456d-ad3f-3bc7f997a48b': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.5.0.0"><References><File ovf:href="77bd3941-a78c-4928-8654-47c360ed4a11/8b3284b5-81f1-42b0-8a18-a9bd4eecfc81" ovf:id="8b3284b5-81f1-42b0-8a18-a9bd4eecfc81" ovf:size="5368709120" ovf:description="Active VM"/><Nic ovf:id="05a2b104-f182-4a77-b550-50a7c04a7e66"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="8b3284b5-81f1-42b0-8a18-a9bd4eecfc81" ovf:size="5" ovf:actual_size="0" ovf:vm_snapshot_id="203b7c45-1004-42bb-af21-844c22b1b80f" ovf:parentRef="" ovf:fileRef="77bd3941-a78c-4928-8654-47c360ed4a11/8b3284b5-81f1-42b0-8a18-a9bd4eecfc81" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Comment></Comment><CreationDate>2014/09/15 19:38:24</CreationDate><ExportDate>2014/09/15 19:47:23</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone>Etc/GMT</TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><IsBootMenuEnabled>false</IsBootMenuEnabled><IsSpiceFileTransferEnabled>true</IsSpiceFileTransferEnabled><IsSpiceCopyPasteEnabled>true</IsSpiceCopyPasteEnabled><Name>vm_thin</Name><TemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</TemplateId><TemplateName>template_01</TemplateName><IsInitilized>false</IsInitilized><Origin>3</Origin><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</OriginalTemplateId><OriginalTemplateName>template_01</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="d647f1f6-8517-456d-ad3f-3bc7f997a48b" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.5.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_Disk1</rasd:Caption><rasd:InstanceId>8b3284b5-81f1-42b0-8a18-a9bd4eecfc81</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>77bd3941-a78c-4928-8654-47c360ed4a11/8b3284b5-81f1-42b0-8a18-a9bd4eecfc81</rasd:HostResource><rasd:Parent>e0fad42b-ca97-416c-9867-03fd34939346</rasd:Parent><rasd:Template>e0fad42b-ca97-416c-9867-03fd34939346</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>b66bf4f1-94ad-487c-aa76-34598a679d7b</rasd:StorageId><rasd:StoragePoolId>da06caa7-b08d-4685-b49c-84565c268648</rasd:StoragePoolId><rasd:CreationDate>2014/09/15 19:38:25</rasd:CreationDate><rasd:LastModified>1970/01/01 00:00:00</rasd:LastModified><rasd:last_modified_date>2014/09/15 19:47:23</rasd:last_modified_date><Type>disk</Type><Device>disk</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}</rasd:Address><BootOrder>1</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-disk0</Alias></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>05a2b104-f182-4a77-b550-50a7c04a7e66</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:1b:81:01</rasd:MACAddress><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>net0</Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>897d3137-1064-45b9-84b7-273fb7d53292</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>404558d5-db3d-4715-b620-e914e5ffee3e</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>9cd3eac9-3e32-445c-bdff-d750de625a2c</rasd:InstanceId><Type>channel</Type><Device>spicevmc</Device><rasd:Address>{port=3, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel2</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>497fad76-9e29-4177-bf7a-c12b984caff4</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=1, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>5da0f131-81e9-4769-bdff-9dfc9c452c3d</rasd:InstanceId><Type>controller</Type><Device>usb</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>usb0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>6c4f4e12-ef3f-4794-9378-61bdcb8ab133</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=2, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel1</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>7dc3ea9b-4227-4be6-8156-2d07f1b4f034</rasd:InstanceId><Type>controller</Type><Device>ide</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>ide0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>0e11ee04-add0-4e5a-aa0d-a1a93531696b</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>scsi0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>3180e61e-cdac-46ba-b9a5-aa7e36e011ad</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>balloon0</Alias><SpecParams><model>virtio</model></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>ec701dae-60b5-4021-b5da-ab5b43bc407a</rasd:InstanceId><Type>controller</Type><Device>virtio-serial</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-serial0</Alias></Item></Section><Section xsi:type="ovf:SnapshotsSection_Type"><Snapshot ovf:id="203b7c45-1004-42bb-af21-844c22b1b80f"><Type>ACTIVE</Type><Description>Active VM</Description><CreationDate>2014/09/15 19:38:24</CreationDate></Snapshot></Section></Content></ovf:Envelope>', u'8336006d-108b-4baa-a383-8db50c8550b3': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.5.0.0"><References><File ovf:href="eddf19a5-5b3b-47f4-b3c0-1e5010d2b010/cdf97095-e01f-4954-8f18-d47b23db3b8e" ovf:id="cdf97095-e01f-4954-8f18-d47b23db3b8e" ovf:size="5368709120" ovf:description="Active VM"/><Nic ovf:id="371d03af-d74e-46c2-aae7-adbea123a19c"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="cdf97095-e01f-4954-8f18-d47b23db3b8e" ovf:size="5" ovf:actual_size="1" ovf:vm_snapshot_id="3bd5af76-49b6-4eea-aad4-7ffdc5e86433" ovf:parentRef="" ovf:fileRef="eddf19a5-5b3b-47f4-b3c0-1e5010d2b010/cdf97095-e01f-4954-8f18-d47b23db3b8e" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Comment></Comment><CreationDate>2014/09/15 19:39:02</CreationDate><ExportDate>2014/09/15 19:51:05</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone>Etc/GMT</TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><IsBootMenuEnabled>false</IsBootMenuEnabled><IsSpiceFileTransferEnabled>true</IsSpiceFileTransferEnabled><IsSpiceCopyPasteEnabled>true</IsSpiceCopyPasteEnabled><Name>vm_clone</Name><TemplateId>00000000-0000-0000-0000-000000000000</TemplateId><TemplateName>Blank</TemplateName><IsInitilized>false</IsInitilized><Origin>3</Origin><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</OriginalTemplateId><OriginalTemplateName>template_01</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="8336006d-108b-4baa-a383-8db50c8550b3" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.5.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_Disk1</rasd:Caption><rasd:InstanceId>cdf97095-e01f-4954-8f18-d47b23db3b8e</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>eddf19a5-5b3b-47f4-b3c0-1e5010d2b010/cdf97095-e01f-4954-8f18-d47b23db3b8e</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>b66bf4f1-94ad-487c-aa76-34598a679d7b</rasd:StorageId><rasd:StoragePoolId>da06caa7-b08d-4685-b49c-84565c268648</rasd:StoragePoolId><rasd:CreationDate>2014/09/15 19:39:03</rasd:CreationDate><rasd:LastModified>1970/01/01 00:00:00</rasd:LastModified><rasd:last_modified_date>2014/09/15 19:51:05</rasd:last_modified_date><Type>disk</Type><Device>disk</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}</rasd:Address><BootOrder>1</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-disk0</Alias></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>371d03af-d74e-46c2-aae7-adbea123a19c</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:1b:81:02</rasd:MACAddress><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>net0</Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>154e50e8-0178-402d-a317-480c7dcdcb4b</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>85424e3d-0d99-4418-9b34-78cadb583162</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>d73a0de4-bb99-4132-b336-8988d43218f9</rasd:InstanceId><Type>channel</Type><Device>spicevmc</Device><rasd:Address>{port=3, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel2</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>ddd2e0a1-332e-4141-a7de-f862bd058c3e</rasd:InstanceId><Type>controller</Type><Device>usb</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>usb0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>f25258af-d547-4d74-b9df-ed00cfa11228</rasd:InstanceId><Type>controller</Type><Device>ide</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>ide0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>0c5506e1-af6d-484a-88c1-f51799206c7e</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=2, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel1</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>7fe9e7a5-bb21-4138-841a-5337c1535778</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=1, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>8e6e5e40-5c2e-45fd-b6b6-002a6d06fa1e</rasd:InstanceId><Type>controller</Type><Device>virtio-serial</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-serial0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>b7a8fae6-c4da-41b8-9d23-7605cce4d1b5</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>scsi0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>27a117d2-ab3c-4673-9b5d-d198c995a1d6</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>balloon0</Alias><SpecParams><model>virtio</model></SpecParams></Item></Section><Section xsi:type="ovf:SnapshotsSection_Type"><Snapshot ovf:id="3bd5af76-49b6-4eea-aad4-7ffdc5e86433"><Type>ACTIVE</Type><Description>Active VM</Description><CreationDate>2014/09/15 19:39:02</CreationDate></Snapshot></Section></Content></ovf:Envelope>'}} >Thread-38::DEBUG::2014-09-16 10:52:17,681::task::1191::Storage.TaskManager.Task::(prepare) Task=`19536d53-4661-47b4-9d09-5ceabc940463`::finished: {'vmlist': {u'c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.5.0.0"><References><File ovf:href="b3abd738-0771-4993-b9c6-b2c410cba99f/e0fad42b-ca97-416c-9867-03fd34939346" ovf:id="e0fad42b-ca97-416c-9867-03fd34939346" ovf:size="5368709120" ovf:description=""/><Nic ovf:id="77794904-2537-4bd6-9247-76472be9e698"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="e0fad42b-ca97-416c-9867-03fd34939346" ovf:size="5" ovf:actual_size="1" ovf:vm_snapshot_id="608a5bdc-e5de-4407-8f39-f92b2a687071" ovf:parentRef="" ovf:fileRef="b3abd738-0771-4993-b9c6-b2c410cba99f/e0fad42b-ca97-416c-9867-03fd34939346" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Comment></Comment><CreationDate>2014/09/15 19:33:13</CreationDate><ExportDate>2014/09/15 19:45:20</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone>Etc/GMT</TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><IsBootMenuEnabled>false</IsBootMenuEnabled><IsSpiceFileTransferEnabled>true</IsSpiceFileTransferEnabled><IsSpiceCopyPasteEnabled>true</IsSpiceCopyPasteEnabled><Name>template_01</Name><TemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</TemplateId><Origin>3</Origin><default_display_type>1</default_display_type><IsDisabled>false</IsDisabled><TrustedService>false</TrustedService><TemplateType>TEMPLATE</TemplateType><BaseTemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</BaseTemplateId><TemplateVersionNumber>1</TemplateVersionNumber><TemplateVersionName>base version</TemplateVersionName><AutoStartup>false</AutoStartup><Section ovf:id="c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.5.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_Disk1</rasd:Caption><rasd:InstanceId>e0fad42b-ca97-416c-9867-03fd34939346</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>b3abd738-0771-4993-b9c6-b2c410cba99f/e0fad42b-ca97-416c-9867-03fd34939346</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>b66bf4f1-94ad-487c-aa76-34598a679d7b</rasd:StorageId><rasd:StoragePoolId>da06caa7-b08d-4685-b49c-84565c268648</rasd:StoragePoolId><rasd:CreationDate>2014/09/15 19:33:13</rasd:CreationDate><rasd:LastModified>1970/01/01 00:00:00</rasd:LastModified><Type>disk</Type><Device>disk</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}</rasd:Address><BootOrder>1</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-disk0</Alias></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>77794904-2537-4bd6-9247-76472be9e698</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>net0</Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>c4b4f86b-d98d-4adc-9d8c-707af5ff455f</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x02, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>video0</Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>766a0087-5feb-4ff0-840f-6642ff47cf45</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>5001a584-b2a9-4d65-a82b-a7b46dde46c3</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=2, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel1</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>2959307c-1338-418d-b9a6-0cebd85043e2</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=1, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>64622ab6-9359-4c37-9733-fb5aeda96b5d</rasd:InstanceId><Type>controller</Type><Device>usb</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>usb0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>801c5c9a-9771-4e5f-ba30-e228b217b9bb</rasd:InstanceId><Type>channel</Type><Device>spicevmc</Device><rasd:Address>{port=3, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel2</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>a95f54f3-cb96-4fe0-a1d0-56b2b5dced07</rasd:InstanceId><Type>controller</Type><Device>ide</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>ide0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>6554c255-573d-4933-9f62-2aaac2b84bb9</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>balloon0</Alias><SpecParams><model>virtio</model></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>cc698b3f-460e-420c-8ea2-179b3ea06665</rasd:InstanceId><Type>controller</Type><Device>virtio-serial</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-serial0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>d2e18bf0-2cd7-422c-ac6f-2526741ce00d</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>scsi0</Alias></Item></Section></Content></ovf:Envelope>', u'd647f1f6-8517-456d-ad3f-3bc7f997a48b': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.5.0.0"><References><File ovf:href="77bd3941-a78c-4928-8654-47c360ed4a11/8b3284b5-81f1-42b0-8a18-a9bd4eecfc81" ovf:id="8b3284b5-81f1-42b0-8a18-a9bd4eecfc81" ovf:size="5368709120" ovf:description="Active VM"/><Nic ovf:id="05a2b104-f182-4a77-b550-50a7c04a7e66"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="8b3284b5-81f1-42b0-8a18-a9bd4eecfc81" ovf:size="5" ovf:actual_size="0" ovf:vm_snapshot_id="203b7c45-1004-42bb-af21-844c22b1b80f" ovf:parentRef="" ovf:fileRef="77bd3941-a78c-4928-8654-47c360ed4a11/8b3284b5-81f1-42b0-8a18-a9bd4eecfc81" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Comment></Comment><CreationDate>2014/09/15 19:38:24</CreationDate><ExportDate>2014/09/15 19:47:23</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone>Etc/GMT</TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><IsBootMenuEnabled>false</IsBootMenuEnabled><IsSpiceFileTransferEnabled>true</IsSpiceFileTransferEnabled><IsSpiceCopyPasteEnabled>true</IsSpiceCopyPasteEnabled><Name>vm_thin</Name><TemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</TemplateId><TemplateName>template_01</TemplateName><IsInitilized>false</IsInitilized><Origin>3</Origin><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</OriginalTemplateId><OriginalTemplateName>template_01</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="d647f1f6-8517-456d-ad3f-3bc7f997a48b" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.5.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_Disk1</rasd:Caption><rasd:InstanceId>8b3284b5-81f1-42b0-8a18-a9bd4eecfc81</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>77bd3941-a78c-4928-8654-47c360ed4a11/8b3284b5-81f1-42b0-8a18-a9bd4eecfc81</rasd:HostResource><rasd:Parent>e0fad42b-ca97-416c-9867-03fd34939346</rasd:Parent><rasd:Template>e0fad42b-ca97-416c-9867-03fd34939346</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>b66bf4f1-94ad-487c-aa76-34598a679d7b</rasd:StorageId><rasd:StoragePoolId>da06caa7-b08d-4685-b49c-84565c268648</rasd:StoragePoolId><rasd:CreationDate>2014/09/15 19:38:25</rasd:CreationDate><rasd:LastModified>1970/01/01 00:00:00</rasd:LastModified><rasd:last_modified_date>2014/09/15 19:47:23</rasd:last_modified_date><Type>disk</Type><Device>disk</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}</rasd:Address><BootOrder>1</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-disk0</Alias></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>05a2b104-f182-4a77-b550-50a7c04a7e66</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:1b:81:01</rasd:MACAddress><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>net0</Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>897d3137-1064-45b9-84b7-273fb7d53292</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>404558d5-db3d-4715-b620-e914e5ffee3e</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>9cd3eac9-3e32-445c-bdff-d750de625a2c</rasd:InstanceId><Type>channel</Type><Device>spicevmc</Device><rasd:Address>{port=3, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel2</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>497fad76-9e29-4177-bf7a-c12b984caff4</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=1, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>5da0f131-81e9-4769-bdff-9dfc9c452c3d</rasd:InstanceId><Type>controller</Type><Device>usb</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>usb0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>6c4f4e12-ef3f-4794-9378-61bdcb8ab133</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=2, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel1</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>7dc3ea9b-4227-4be6-8156-2d07f1b4f034</rasd:InstanceId><Type>controller</Type><Device>ide</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>ide0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>0e11ee04-add0-4e5a-aa0d-a1a93531696b</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>scsi0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>3180e61e-cdac-46ba-b9a5-aa7e36e011ad</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>balloon0</Alias><SpecParams><model>virtio</model></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>ec701dae-60b5-4021-b5da-ab5b43bc407a</rasd:InstanceId><Type>controller</Type><Device>virtio-serial</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-serial0</Alias></Item></Section><Section xsi:type="ovf:SnapshotsSection_Type"><Snapshot ovf:id="203b7c45-1004-42bb-af21-844c22b1b80f"><Type>ACTIVE</Type><Description>Active VM</Description><CreationDate>2014/09/15 19:38:24</CreationDate></Snapshot></Section></Content></ovf:Envelope>', u'8336006d-108b-4baa-a383-8db50c8550b3': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.5.0.0"><References><File ovf:href="eddf19a5-5b3b-47f4-b3c0-1e5010d2b010/cdf97095-e01f-4954-8f18-d47b23db3b8e" ovf:id="cdf97095-e01f-4954-8f18-d47b23db3b8e" ovf:size="5368709120" ovf:description="Active VM"/><Nic ovf:id="371d03af-d74e-46c2-aae7-adbea123a19c"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="cdf97095-e01f-4954-8f18-d47b23db3b8e" ovf:size="5" ovf:actual_size="1" ovf:vm_snapshot_id="3bd5af76-49b6-4eea-aad4-7ffdc5e86433" ovf:parentRef="" ovf:fileRef="eddf19a5-5b3b-47f4-b3c0-1e5010d2b010/cdf97095-e01f-4954-8f18-d47b23db3b8e" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Comment></Comment><CreationDate>2014/09/15 19:39:02</CreationDate><ExportDate>2014/09/15 19:51:05</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone>Etc/GMT</TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><IsBootMenuEnabled>false</IsBootMenuEnabled><IsSpiceFileTransferEnabled>true</IsSpiceFileTransferEnabled><IsSpiceCopyPasteEnabled>true</IsSpiceCopyPasteEnabled><Name>vm_clone</Name><TemplateId>00000000-0000-0000-0000-000000000000</TemplateId><TemplateName>Blank</TemplateName><IsInitilized>false</IsInitilized><Origin>3</Origin><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>c718ba6b-4127-4a6b-9dea-ac2c1a5c6c76</OriginalTemplateId><OriginalTemplateName>template_01</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="8336006d-108b-4baa-a383-8db50c8550b3" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.5.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm_Disk1</rasd:Caption><rasd:InstanceId>cdf97095-e01f-4954-8f18-d47b23db3b8e</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>eddf19a5-5b3b-47f4-b3c0-1e5010d2b010/cdf97095-e01f-4954-8f18-d47b23db3b8e</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>b66bf4f1-94ad-487c-aa76-34598a679d7b</rasd:StorageId><rasd:StoragePoolId>da06caa7-b08d-4685-b49c-84565c268648</rasd:StoragePoolId><rasd:CreationDate>2014/09/15 19:39:03</rasd:CreationDate><rasd:LastModified>1970/01/01 00:00:00</rasd:LastModified><rasd:last_modified_date>2014/09/15 19:51:05</rasd:last_modified_date><Type>disk</Type><Device>disk</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}</rasd:Address><BootOrder>1</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-disk0</Alias></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>371d03af-d74e-46c2-aae7-adbea123a19c</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:1b:81:02</rasd:MACAddress><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>net0</Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>154e50e8-0178-402d-a317-480c7dcdcb4b</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>85424e3d-0d99-4418-9b34-78cadb583162</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>d73a0de4-bb99-4132-b336-8988d43218f9</rasd:InstanceId><Type>channel</Type><Device>spicevmc</Device><rasd:Address>{port=3, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel2</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>ddd2e0a1-332e-4141-a7de-f862bd058c3e</rasd:InstanceId><Type>controller</Type><Device>usb</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>usb0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>f25258af-d547-4d74-b9df-ed00cfa11228</rasd:InstanceId><Type>controller</Type><Device>ide</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>ide0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>0c5506e1-af6d-484a-88c1-f51799206c7e</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=2, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel1</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>7fe9e7a5-bb21-4138-841a-5337c1535778</rasd:InstanceId><Type>channel</Type><Device>unix</Device><rasd:Address>{port=1, bus=0, controller=0, type=virtio-serial}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>channel0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>8e6e5e40-5c2e-45fd-b6b6-002a6d06fa1e</rasd:InstanceId><Type>controller</Type><Device>virtio-serial</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>virtio-serial0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>b7a8fae6-c4da-41b8-9d23-7605cce4d1b5</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias>scsi0</Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>27a117d2-ab3c-4673-9b5d-d198c995a1d6</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address>{bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}</rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias>balloon0</Alias><SpecParams><model>virtio</model></SpecParams></Item></Section><Section xsi:type="ovf:SnapshotsSection_Type"><Snapshot ovf:id="3bd5af76-49b6-4eea-aad4-7ffdc5e86433"><Type>ACTIVE</Type><Description>Active VM</Description><CreationDate>2014/09/15 19:39:02</CreationDate></Snapshot></Section></Content></ovf:Envelope>'}} >Thread-38::DEBUG::2014-09-16 10:52:17,681::task::595::Storage.TaskManager.Task::(_updateState) Task=`19536d53-4661-47b4-9d09-5ceabc940463`::moving from state preparing -> state finished >Dummy-37::DEBUG::2014-09-16 10:52:17,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-38::DEBUG::2014-09-16 10:52:17,682::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408': < ResourceRef 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:52:17,687::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:52:17,688::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408' >Thread-38::DEBUG::2014-09-16 10:52:17,688::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408' (0 active users) >Thread-38::DEBUG::2014-09-16 10:52:17,688::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:52:17,688::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408', Clearing records. >Thread-38::DEBUG::2014-09-16 10:52:17,688::task::993::Storage.TaskManager.Task::(_decref) Task=`19536d53-4661-47b4-9d09-5ceabc940463`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:52:17,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113433 s, 90.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:52:18,725::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:18,725::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:18,725::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:18,725::__init__::232::IOProcess::(_processLogs) (41404) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:18,725::__init__::232::IOProcess::(_processLogs) (41404) Queuing response >Thread-47::DEBUG::2014-09-16 10:52:18,726::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:52:18,731::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000323952 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:52:18,732::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:18,732::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:18,732::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:18,732::__init__::232::IOProcess::(_processLogs) (41405) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:18,732::__init__::232::IOProcess::(_processLogs) (41405) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:18,762::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:18,762::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:18,762::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:18,762::__init__::232::IOProcess::(_processLogs) (41406) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:18,763::__init__::232::IOProcess::(_processLogs) (41406) Queuing response >Thread-21::DEBUG::2014-09-16 10:52:18,763::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:52:18,768::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.00030259 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:52:18,769::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:18,769::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:18,769::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:18,769::__init__::232::IOProcess::(_processLogs) (41407) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:18,769::__init__::232::IOProcess::(_processLogs) (41407) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:18,770::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:18,770::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:18,770::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:18,770::__init__::232::IOProcess::(_processLogs) (41408) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:18,770::__init__::232::IOProcess::(_processLogs) (41408) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:18,771::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:18,771::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:18,771::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:18,771::__init__::232::IOProcess::(_processLogs) (41409) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:18,771::__init__::232::IOProcess::(_processLogs) (41409) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:18,772::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:18,772::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:18,772::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:18,772::__init__::232::IOProcess::(_processLogs) (41410) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:18,772::__init__::232::IOProcess::(_processLogs) (41410) Queuing response >Dummy-37::DEBUG::2014-09-16 10:52:19,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:19,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113648 s, 90.1 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:52:21,404::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] flowID [62c73b14] >Thread-97::DEBUG::2014-09-16 10:52:21,405::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7709a20-6325-412e-8fb8-8912fed8c158`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:52:21,405::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:52:21,417::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:52:21,417::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7709a20-6325-412e-8fb8-8912fed8c158`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:52:21,417::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7709a20-6325-412e-8fb8-8912fed8c158`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:52:21,417::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:52:21,417::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:52:21,417::task::993::Storage.TaskManager.Task::(_decref) Task=`e7709a20-6325-412e-8fb8-8912fed8c158`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:52:21,447::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] flowID [62c73b14] >Thread-38::DEBUG::2014-09-16 10:52:21,447::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab28c6b4-b85e-49b7-beb9-f00923099e0b`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:52:21,447::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:52:21,447::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`32288302-4283-4fc4-828f-56ce2b83682b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:52:21,447::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:52:21,448::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:52:21,448::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`32288302-4283-4fc4-828f-56ce2b83682b`::Granted request >Thread-38::DEBUG::2014-09-16 10:52:21,448::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ab28c6b4-b85e-49b7-beb9-f00923099e0b`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:52:21,448::task::993::Storage.TaskManager.Task::(_decref) Task=`ab28c6b4-b85e-49b7-beb9-f00923099e0b`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:52:21,460::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:52:21,460::task::1191::Storage.TaskManager.Task::(prepare) Task=`ab28c6b4-b85e-49b7-beb9-f00923099e0b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:52:21,460::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab28c6b4-b85e-49b7-beb9-f00923099e0b`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:52:21,460::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:52:21,460::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:52:21,460::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:52:21,460::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:52:21,461::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:52:21,461::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:52:21,461::task::993::Storage.TaskManager.Task::(_decref) Task=`ab28c6b4-b85e-49b7-beb9-f00923099e0b`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:52:21,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:21,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011366 s, 90.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:52:23,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:23,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113277 s, 90.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:52:25,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:25,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112913 s, 90.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:52:27,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:27,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114376 s, 89.5 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:52:28,122::task::595::Storage.TaskManager.Task::(_updateState) Task=`9558d28d-43cb-410e-8ab3-8e2ce79cec33`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:52:28,122::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:52:28,122::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000323952', 'lastCheck': '9.4', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00030259', 'lastCheck': '9.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:52:28,122::task::1191::Storage.TaskManager.Task::(prepare) Task=`9558d28d-43cb-410e-8ab3-8e2ce79cec33`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000323952', 'lastCheck': '9.4', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00030259', 'lastCheck': '9.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:52:28,122::task::595::Storage.TaskManager.Task::(_updateState) Task=`9558d28d-43cb-410e-8ab3-8e2ce79cec33`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:52:28,123::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:52:28,123::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:52:28,123::task::993::Storage.TaskManager.Task::(_decref) Task=`9558d28d-43cb-410e-8ab3-8e2ce79cec33`::ref 0 aborting False >Thread-14::DEBUG::2014-09-16 10:52:28,734::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:28,734::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:28,734::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:28,734::__init__::232::IOProcess::(_processLogs) (41411) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:28,734::__init__::232::IOProcess::(_processLogs) (41411) Queuing response >Thread-47::DEBUG::2014-09-16 10:52:28,734::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:52:28,740::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000309521 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:52:28,741::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:28,741::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:28,741::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:28,741::__init__::232::IOProcess::(_processLogs) (41412) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:28,741::__init__::232::IOProcess::(_processLogs) (41412) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:28,773::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:28,773::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:28,773::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:28,773::__init__::232::IOProcess::(_processLogs) (41413) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:28,773::__init__::232::IOProcess::(_processLogs) (41413) Queuing response >Thread-21::DEBUG::2014-09-16 10:52:28,774::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:52:28,779::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000280289 s, 1.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:52:28,780::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:28,780::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:28,780::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:28,780::__init__::232::IOProcess::(_processLogs) (41414) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:28,780::__init__::232::IOProcess::(_processLogs) (41414) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:28,781::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:28,781::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:28,781::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:28,781::__init__::232::IOProcess::(_processLogs) (41415) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:28,781::__init__::232::IOProcess::(_processLogs) (41415) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:28,782::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:28,782::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:28,782::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:28,782::__init__::232::IOProcess::(_processLogs) (41416) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:28,782::__init__::232::IOProcess::(_processLogs) (41416) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:28,783::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:28,783::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:28,783::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:28,783::__init__::232::IOProcess::(_processLogs) (41417) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:28,783::__init__::232::IOProcess::(_processLogs) (41417) Queuing response >Dummy-37::DEBUG::2014-09-16 10:52:29,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:30,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113804 s, 90.0 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:52:31,716::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:52:31,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad6c0c85-65b8-4ad1-b5ac-a7b32256e98c`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:52:31,717::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:52:31,729::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:52:31,729::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad6c0c85-65b8-4ad1-b5ac-a7b32256e98c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:52:31,729::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad6c0c85-65b8-4ad1-b5ac-a7b32256e98c`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:52:31,729::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:52:31,729::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:52:31,729::task::993::Storage.TaskManager.Task::(_decref) Task=`ad6c0c85-65b8-4ad1-b5ac-a7b32256e98c`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:52:31,763::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:52:31,763::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca7f1c18-c0cd-42b9-9c08-663eb6092051`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:52:31,763::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:52:31,763::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`4e6da777-4d13-47bc-a38e-b5e6b9f22c77`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:52:31,763::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:52:31,764::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:52:31,764::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`4e6da777-4d13-47bc-a38e-b5e6b9f22c77`::Granted request >Thread-38::DEBUG::2014-09-16 10:52:31,764::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ca7f1c18-c0cd-42b9-9c08-663eb6092051`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:52:31,764::task::993::Storage.TaskManager.Task::(_decref) Task=`ca7f1c18-c0cd-42b9-9c08-663eb6092051`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:52:31,776::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:52:31,776::task::1191::Storage.TaskManager.Task::(prepare) Task=`ca7f1c18-c0cd-42b9-9c08-663eb6092051`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:52:31,776::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca7f1c18-c0cd-42b9-9c08-663eb6092051`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:52:31,776::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:52:31,776::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:52:31,777::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:52:31,777::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:52:31,777::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:52:31,777::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:52:31,777::task::993::Storage.TaskManager.Task::(_decref) Task=`ca7f1c18-c0cd-42b9-9c08-663eb6092051`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:52:32,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:32,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125495 s, 81.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:52:34,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:34,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112921 s, 90.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:52:36,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:36,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116175 s, 88.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:52:38,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:38,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011251 s, 91.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:52:38,742::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:38,742::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:38,743::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:38,743::__init__::232::IOProcess::(_processLogs) (41418) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:38,743::__init__::232::IOProcess::(_processLogs) (41418) Queuing response >Thread-47::DEBUG::2014-09-16 10:52:38,743::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:52:38,749::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000306492 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:52:38,749::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:38,749::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:38,750::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:38,750::__init__::232::IOProcess::(_processLogs) (41419) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:38,750::__init__::232::IOProcess::(_processLogs) (41419) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:38,784::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:38,784::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:38,784::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:38,784::__init__::232::IOProcess::(_processLogs) (41420) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:38,784::__init__::232::IOProcess::(_processLogs) (41420) Queuing response >Thread-21::DEBUG::2014-09-16 10:52:38,785::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:52:38,790::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000330171 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:52:38,791::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:38,791::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:38,791::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:38,791::__init__::232::IOProcess::(_processLogs) (41421) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:38,791::__init__::232::IOProcess::(_processLogs) (41421) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:38,792::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:38,792::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:38,792::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:38,792::__init__::232::IOProcess::(_processLogs) (41422) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:38,793::__init__::232::IOProcess::(_processLogs) (41422) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:38,793::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:38,793::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:38,793::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:38,793::__init__::232::IOProcess::(_processLogs) (41423) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:38,793::__init__::232::IOProcess::(_processLogs) (41423) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:38,794::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:38,794::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:38,794::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:38,794::__init__::232::IOProcess::(_processLogs) (41424) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:38,794::__init__::232::IOProcess::(_processLogs) (41424) Queuing response >Dummy-37::DEBUG::2014-09-16 10:52:40,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:40,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01117 s, 91.7 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:52:42,081::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:52:42,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab4160f7-cc01-4487-92ba-8067a74a6d16`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:52:42,081::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:52:42,092::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:52:42,092::task::1191::Storage.TaskManager.Task::(prepare) Task=`ab4160f7-cc01-4487-92ba-8067a74a6d16`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:52:42,092::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab4160f7-cc01-4487-92ba-8067a74a6d16`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:52:42,092::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:52:42,093::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:52:42,093::task::993::Storage.TaskManager.Task::(_decref) Task=`ab4160f7-cc01-4487-92ba-8067a74a6d16`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:52:42,122::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:52:42,122::task::595::Storage.TaskManager.Task::(_updateState) Task=`0181d2e6-c2f8-48c2-9d0a-007049aa8609`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:52:42,122::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:52:42,123::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`7fe82c96-c1ba-430f-a527-773dd9efa0ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:52:42,123::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:52:42,123::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:52:42,123::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`7fe82c96-c1ba-430f-a527-773dd9efa0ce`::Granted request >Thread-38::DEBUG::2014-09-16 10:52:42,123::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0181d2e6-c2f8-48c2-9d0a-007049aa8609`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:52:42,123::task::993::Storage.TaskManager.Task::(_decref) Task=`0181d2e6-c2f8-48c2-9d0a-007049aa8609`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:52:42,135::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:52:42,135::task::1191::Storage.TaskManager.Task::(prepare) Task=`0181d2e6-c2f8-48c2-9d0a-007049aa8609`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:52:42,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`0181d2e6-c2f8-48c2-9d0a-007049aa8609`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:52:42,136::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:52:42,136::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:52:42,136::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:52:42,136::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:52:42,136::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:52:42,136::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:52:42,136::task::993::Storage.TaskManager.Task::(_decref) Task=`0181d2e6-c2f8-48c2-9d0a-007049aa8609`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:52:42,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:42,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113048 s, 90.6 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:52:43,909::task::595::Storage.TaskManager.Task::(_updateState) Task=`35847904-b81b-40cd-a505-0b3cd43ddc26`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:52:43,909::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:52:43,909::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000306492', 'lastCheck': '5.2', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330171', 'lastCheck': '5.1', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:52:43,909::task::1191::Storage.TaskManager.Task::(prepare) Task=`35847904-b81b-40cd-a505-0b3cd43ddc26`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000306492', 'lastCheck': '5.2', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330171', 'lastCheck': '5.1', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:52:43,910::task::595::Storage.TaskManager.Task::(_updateState) Task=`35847904-b81b-40cd-a505-0b3cd43ddc26`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:52:43,910::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:52:43,910::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:52:43,910::task::993::Storage.TaskManager.Task::(_decref) Task=`35847904-b81b-40cd-a505-0b3cd43ddc26`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:52:44,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:44,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0213026 s, 48.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:52:46,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:46,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112076 s, 91.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:52:48,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:48,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112885 s, 90.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:52:48,751::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:48,751::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:48,751::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:48,751::__init__::232::IOProcess::(_processLogs) (41425) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:48,752::__init__::232::IOProcess::(_processLogs) (41425) Queuing response >Thread-47::DEBUG::2014-09-16 10:52:48,752::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:52:48,758::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000314393 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:52:48,759::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:48,759::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:48,759::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:48,759::__init__::232::IOProcess::(_processLogs) (41426) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:48,759::__init__::232::IOProcess::(_processLogs) (41426) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:48,795::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:48,795::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:48,795::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:48,795::__init__::232::IOProcess::(_processLogs) (41427) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:48,795::__init__::232::IOProcess::(_processLogs) (41427) Queuing response >Thread-21::DEBUG::2014-09-16 10:52:48,796::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:52:48,801::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000317073 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:52:48,802::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:48,802::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:48,802::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:48,802::__init__::232::IOProcess::(_processLogs) (41428) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:48,802::__init__::232::IOProcess::(_processLogs) (41428) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:48,803::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:48,803::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:48,803::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:48,803::__init__::232::IOProcess::(_processLogs) (41429) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:48,804::__init__::232::IOProcess::(_processLogs) (41429) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:48,804::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:48,804::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:48,804::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:48,804::__init__::232::IOProcess::(_processLogs) (41430) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:48,804::__init__::232::IOProcess::(_processLogs) (41430) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:48,805::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:48,805::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:48,805::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:48,805::__init__::232::IOProcess::(_processLogs) (41431) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:48,805::__init__::232::IOProcess::(_processLogs) (41431) Queuing response >Dummy-37::DEBUG::2014-09-16 10:52:50,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:50,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113966 s, 89.9 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:52:52,221::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:52:52,221::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ca438cc-b631-4854-a257-cadc728dc354`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:52:52,221::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:52:52,232::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:52:52,232::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ca438cc-b631-4854-a257-cadc728dc354`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:52:52,232::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ca438cc-b631-4854-a257-cadc728dc354`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:52:52,233::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:52:52,233::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:52:52,233::task::993::Storage.TaskManager.Task::(_decref) Task=`2ca438cc-b631-4854-a257-cadc728dc354`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:52:52,264::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:52:52,264::task::595::Storage.TaskManager.Task::(_updateState) Task=`f93f7c5c-1d0c-4442-a4f0-21e5e3bce977`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:52:52,264::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:52:52,264::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`4a291153-9193-4812-b698-d5f48f2cc205`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:52:52,264::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:52:52,264::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:52:52,265::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`4a291153-9193-4812-b698-d5f48f2cc205`::Granted request >Thread-38::DEBUG::2014-09-16 10:52:52,265::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f93f7c5c-1d0c-4442-a4f0-21e5e3bce977`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:52:52,265::task::993::Storage.TaskManager.Task::(_decref) Task=`f93f7c5c-1d0c-4442-a4f0-21e5e3bce977`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:52:52,277::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:52:52,277::task::1191::Storage.TaskManager.Task::(prepare) Task=`f93f7c5c-1d0c-4442-a4f0-21e5e3bce977`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:52:52,277::task::595::Storage.TaskManager.Task::(_updateState) Task=`f93f7c5c-1d0c-4442-a4f0-21e5e3bce977`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:52:52,277::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:52:52,277::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:52:52,277::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:52:52,277::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:52:52,277::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:52:52,277::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:52:52,278::task::993::Storage.TaskManager.Task::(_decref) Task=`f93f7c5c-1d0c-4442-a4f0-21e5e3bce977`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:52:52,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:52,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112783 s, 90.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:52:54,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:54,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112655 s, 90.9 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:52:56,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:52:56,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112842 s, 90.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:52:58,760::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:58,761::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:58,761::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:58,761::__init__::232::IOProcess::(_processLogs) (41432) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:58,761::__init__::232::IOProcess::(_processLogs) (41432) Queuing response >Thread-47::DEBUG::2014-09-16 10:52:58,762::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:52:58,767::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000307333 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:52:58,768::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:58,768::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:58,768::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:58,768::__init__::232::IOProcess::(_processLogs) (41433) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:58,768::__init__::232::IOProcess::(_processLogs) (41433) Queuing response >Dummy-37::DEBUG::2014-09-16 10:52:58,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-09-16 10:52:58,806::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:58,807::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:58,807::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:58,807::__init__::232::IOProcess::(_processLogs) (41434) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:58,811::__init__::232::IOProcess::(_processLogs) (41434) Queuing response >Thread-21::DEBUG::2014-09-16 10:52:58,814::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:52:58,820::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000263231 s, 1.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:52:58,822::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:58,823::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:58,823::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:58,824::__init__::232::IOProcess::(_processLogs) (41435) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:52:58,824::__init__::232::IOProcess::(_processLogs) (41435) Queuing response >Dummy-37::DEBUG::2014-09-16 10:52:58,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247437 s, 41.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:52:58,851::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:58,852::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:58,852::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:58,853::__init__::232::IOProcess::(_processLogs) (41436) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:58,853::__init__::232::IOProcess::(_processLogs) (41436) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:58,855::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:58,855::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:58,855::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:58,856::__init__::232::IOProcess::(_processLogs) (41437) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:58,856::__init__::232::IOProcess::(_processLogs) (41437) Queuing response >Thread-14::DEBUG::2014-09-16 10:52:58,858::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:52:58,858::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:52:58,858::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:52:58,859::__init__::232::IOProcess::(_processLogs) (41438) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:52:58,859::__init__::232::IOProcess::(_processLogs) (41438) Queuing response >Thread-97::DEBUG::2014-09-16 10:52:59,243::task::595::Storage.TaskManager.Task::(_updateState) Task=`82b7e590-0cd4-4f32-bf23-909f2646ba47`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:52:59,243::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:52:59,244::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000307333', 'lastCheck': '0.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263231', 'lastCheck': '0.4', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:52:59,244::task::1191::Storage.TaskManager.Task::(prepare) Task=`82b7e590-0cd4-4f32-bf23-909f2646ba47`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000307333', 'lastCheck': '0.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263231', 'lastCheck': '0.4', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:52:59,244::task::595::Storage.TaskManager.Task::(_updateState) Task=`82b7e590-0cd4-4f32-bf23-909f2646ba47`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:52:59,244::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:52:59,244::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:52:59,244::task::993::Storage.TaskManager.Task::(_decref) Task=`82b7e590-0cd4-4f32-bf23-909f2646ba47`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:53:00,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:00,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011317 s, 90.5 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:53:02,548::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] flowID [62c73b14] >Thread-97::DEBUG::2014-09-16 10:53:02,548::task::595::Storage.TaskManager.Task::(_updateState) Task=`970045fa-fc45-47b7-b47b-f96991f41362`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:53:02,548::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:53:02,560::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:53:02,560::task::1191::Storage.TaskManager.Task::(prepare) Task=`970045fa-fc45-47b7-b47b-f96991f41362`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:53:02,560::task::595::Storage.TaskManager.Task::(_updateState) Task=`970045fa-fc45-47b7-b47b-f96991f41362`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:53:02,560::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:53:02,560::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:53:02,560::task::993::Storage.TaskManager.Task::(_decref) Task=`970045fa-fc45-47b7-b47b-f96991f41362`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:53:02,593::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] flowID [62c73b14] >Thread-38::DEBUG::2014-09-16 10:53:02,594::task::595::Storage.TaskManager.Task::(_updateState) Task=`d062a143-0fd9-43d1-ae95-e7d69d967b48`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:53:02,594::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:53:02,594::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`8cc5c957-891f-454d-a955-4e7c17d50dc4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:53:02,594::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:53:02,595::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:53:02,595::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`8cc5c957-891f-454d-a955-4e7c17d50dc4`::Granted request >Thread-38::DEBUG::2014-09-16 10:53:02,595::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d062a143-0fd9-43d1-ae95-e7d69d967b48`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:53:02,595::task::993::Storage.TaskManager.Task::(_decref) Task=`d062a143-0fd9-43d1-ae95-e7d69d967b48`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:53:02,607::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:53:02,607::task::1191::Storage.TaskManager.Task::(prepare) Task=`d062a143-0fd9-43d1-ae95-e7d69d967b48`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:53:02,607::task::595::Storage.TaskManager.Task::(_updateState) Task=`d062a143-0fd9-43d1-ae95-e7d69d967b48`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:53:02,607::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:53:02,607::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:53:02,607::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:53:02,607::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:53:02,608::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:53:02,608::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:53:02,608::task::993::Storage.TaskManager.Task::(_decref) Task=`d062a143-0fd9-43d1-ae95-e7d69d967b48`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:53:02,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:02,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125077 s, 81.9 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:53:04,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:05,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113658 s, 90.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:53:07,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:07,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112444 s, 91.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:08,769::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:08,769::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:08,769::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:08,770::__init__::232::IOProcess::(_processLogs) (41439) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:08,770::__init__::232::IOProcess::(_processLogs) (41439) Queuing response >Thread-47::DEBUG::2014-09-16 10:53:08,770::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:53:08,776::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000326755 s, 995 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:08,777::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:08,777::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:08,777::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:08,777::__init__::232::IOProcess::(_processLogs) (41440) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:08,777::__init__::232::IOProcess::(_processLogs) (41440) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:08,861::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:08,861::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:08,861::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:08,861::__init__::232::IOProcess::(_processLogs) (41441) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:08,861::__init__::232::IOProcess::(_processLogs) (41441) Queuing response >Thread-21::DEBUG::2014-09-16 10:53:08,862::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:53:08,867::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000307229 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:08,868::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:08,868::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:08,868::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:08,868::__init__::232::IOProcess::(_processLogs) (41442) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:08,868::__init__::232::IOProcess::(_processLogs) (41442) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:08,869::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:08,869::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:08,869::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:08,869::__init__::232::IOProcess::(_processLogs) (41443) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:08,870::__init__::232::IOProcess::(_processLogs) (41443) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:08,870::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:08,870::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:08,870::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:08,870::__init__::232::IOProcess::(_processLogs) (41444) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:08,870::__init__::232::IOProcess::(_processLogs) (41444) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:08,871::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:08,871::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:08,871::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:08,871::__init__::232::IOProcess::(_processLogs) (41445) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:08,871::__init__::232::IOProcess::(_processLogs) (41445) Queuing response >Dummy-37::DEBUG::2014-09-16 10:53:09,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:09,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114783 s, 89.2 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:53:11,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:11,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113026 s, 90.6 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:53:12,999::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:53:13,000::task::595::Storage.TaskManager.Task::(_updateState) Task=`c958ed85-f53f-4c66-8585-25d2138e7057`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:53:13,000::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:53:13,011::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:53:13,011::task::1191::Storage.TaskManager.Task::(prepare) Task=`c958ed85-f53f-4c66-8585-25d2138e7057`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:53:13,011::task::595::Storage.TaskManager.Task::(_updateState) Task=`c958ed85-f53f-4c66-8585-25d2138e7057`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:53:13,011::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:53:13,011::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:53:13,012::task::993::Storage.TaskManager.Task::(_decref) Task=`c958ed85-f53f-4c66-8585-25d2138e7057`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:53:13,047::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:53:13,047::task::595::Storage.TaskManager.Task::(_updateState) Task=`79dc0bd0-82b7-4569-afa2-b0e8e8784eef`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:53:13,047::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:53:13,047::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`5c60dfcb-db63-4ab1-bbd9-6af4269ab301`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:53:13,047::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:53:13,048::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:53:13,048::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`5c60dfcb-db63-4ab1-bbd9-6af4269ab301`::Granted request >Thread-38::DEBUG::2014-09-16 10:53:13,048::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`79dc0bd0-82b7-4569-afa2-b0e8e8784eef`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:53:13,048::task::993::Storage.TaskManager.Task::(_decref) Task=`79dc0bd0-82b7-4569-afa2-b0e8e8784eef`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:53:13,060::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:53:13,060::task::1191::Storage.TaskManager.Task::(prepare) Task=`79dc0bd0-82b7-4569-afa2-b0e8e8784eef`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:53:13,060::task::595::Storage.TaskManager.Task::(_updateState) Task=`79dc0bd0-82b7-4569-afa2-b0e8e8784eef`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:53:13,060::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:53:13,060::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:53:13,060::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:53:13,061::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:53:13,061::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:53:13,061::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:53:13,061::task::993::Storage.TaskManager.Task::(_decref) Task=`79dc0bd0-82b7-4569-afa2-b0e8e8784eef`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:53:13,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:13,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114065 s, 89.8 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:53:14,808::task::595::Storage.TaskManager.Task::(_updateState) Task=`eca15067-9bc8-4825-8145-0b0695a7a6b6`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:53:14,808::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:53:14,809::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000326755', 'lastCheck': '6.0', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307229', 'lastCheck': '5.9', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:53:14,810::task::1191::Storage.TaskManager.Task::(prepare) Task=`eca15067-9bc8-4825-8145-0b0695a7a6b6`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000326755', 'lastCheck': '6.0', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307229', 'lastCheck': '5.9', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:53:14,810::task::595::Storage.TaskManager.Task::(_updateState) Task=`eca15067-9bc8-4825-8145-0b0695a7a6b6`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:53:14,810::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:53:14,811::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:53:14,811::task::993::Storage.TaskManager.Task::(_decref) Task=`eca15067-9bc8-4825-8145-0b0695a7a6b6`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:53:15,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:15,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113538 s, 90.2 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:53:17,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:17,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113763 s, 90.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:18,778::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:18,778::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:18,779::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:18,779::__init__::232::IOProcess::(_processLogs) (41446) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:18,779::__init__::232::IOProcess::(_processLogs) (41446) Queuing response >Thread-47::DEBUG::2014-09-16 10:53:18,779::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:53:18,785::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000309119 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:18,786::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:18,786::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:18,786::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:18,786::__init__::232::IOProcess::(_processLogs) (41447) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:18,786::__init__::232::IOProcess::(_processLogs) (41447) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:18,872::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:18,872::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:18,872::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:18,872::__init__::232::IOProcess::(_processLogs) (41448) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:18,873::__init__::232::IOProcess::(_processLogs) (41448) Queuing response >Thread-21::DEBUG::2014-09-16 10:53:18,873::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:53:18,878::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000321614 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:18,879::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:18,879::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:18,879::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:18,879::__init__::232::IOProcess::(_processLogs) (41449) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:18,879::__init__::232::IOProcess::(_processLogs) (41449) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:18,880::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:18,880::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:18,880::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:18,881::__init__::232::IOProcess::(_processLogs) (41450) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:18,881::__init__::232::IOProcess::(_processLogs) (41450) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:18,881::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:18,881::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:18,881::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:18,881::__init__::232::IOProcess::(_processLogs) (41451) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:18,881::__init__::232::IOProcess::(_processLogs) (41451) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:18,882::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:18,882::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:18,882::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:18,882::__init__::232::IOProcess::(_processLogs) (41452) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:18,882::__init__::232::IOProcess::(_processLogs) (41452) Queuing response >Dummy-37::DEBUG::2014-09-16 10:53:19,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:19,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114231 s, 89.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:53:21,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:21,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113093 s, 90.5 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:53:23,237::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:53:23,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a523756-c4f5-49bb-a115-ac2eb3be7e48`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:53:23,237::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:53:23,249::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:53:23,249::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a523756-c4f5-49bb-a115-ac2eb3be7e48`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:53:23,249::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a523756-c4f5-49bb-a115-ac2eb3be7e48`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:53:23,249::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:53:23,249::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:53:23,249::task::993::Storage.TaskManager.Task::(_decref) Task=`3a523756-c4f5-49bb-a115-ac2eb3be7e48`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:53:23,331::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:53:23,331::task::595::Storage.TaskManager.Task::(_updateState) Task=`69a1ebff-bcd8-46b1-8e58-ab9e025464a8`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:53:23,331::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:53:23,331::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`4b2e6bff-6838-476b-8b02-0f2765be4e0f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:53:23,331::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:53:23,332::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:53:23,332::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`4b2e6bff-6838-476b-8b02-0f2765be4e0f`::Granted request >Thread-38::DEBUG::2014-09-16 10:53:23,332::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`69a1ebff-bcd8-46b1-8e58-ab9e025464a8`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:53:23,332::task::993::Storage.TaskManager.Task::(_decref) Task=`69a1ebff-bcd8-46b1-8e58-ab9e025464a8`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:53:23,344::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:53:23,344::task::1191::Storage.TaskManager.Task::(prepare) Task=`69a1ebff-bcd8-46b1-8e58-ab9e025464a8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:53:23,344::task::595::Storage.TaskManager.Task::(_updateState) Task=`69a1ebff-bcd8-46b1-8e58-ab9e025464a8`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:53:23,344::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:53:23,344::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:53:23,345::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:53:23,345::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:53:23,345::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:53:23,345::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:53:23,345::task::993::Storage.TaskManager.Task::(_decref) Task=`69a1ebff-bcd8-46b1-8e58-ab9e025464a8`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:53:23,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:23,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114019 s, 89.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:53:25,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:25,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113132 s, 90.5 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:53:27,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:27,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113218 s, 90.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:28,787::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:28,787::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:28,787::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:28,788::__init__::232::IOProcess::(_processLogs) (41453) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:28,788::__init__::232::IOProcess::(_processLogs) (41453) Queuing response >Thread-47::DEBUG::2014-09-16 10:53:28,788::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:53:28,794::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000332975 s, 976 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:28,794::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:28,794::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:28,795::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:28,795::__init__::232::IOProcess::(_processLogs) (41454) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:28,795::__init__::232::IOProcess::(_processLogs) (41454) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:28,883::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:28,883::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:28,883::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:28,883::__init__::232::IOProcess::(_processLogs) (41455) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:28,884::__init__::232::IOProcess::(_processLogs) (41455) Queuing response >Thread-21::DEBUG::2014-09-16 10:53:28,884::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:53:28,889::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000302627 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:28,890::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:28,890::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:28,890::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:28,890::__init__::232::IOProcess::(_processLogs) (41456) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:28,890::__init__::232::IOProcess::(_processLogs) (41456) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:28,891::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:28,891::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:28,891::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:28,891::__init__::232::IOProcess::(_processLogs) (41457) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:28,891::__init__::232::IOProcess::(_processLogs) (41457) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:28,892::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:28,892::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:28,892::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:28,892::__init__::232::IOProcess::(_processLogs) (41458) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:28,892::__init__::232::IOProcess::(_processLogs) (41458) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:28,893::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:28,893::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:28,893::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:28,893::__init__::232::IOProcess::(_processLogs) (41459) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:28,893::__init__::232::IOProcess::(_processLogs) (41459) Queuing response >Dummy-37::DEBUG::2014-09-16 10:53:29,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:29,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112938 s, 90.7 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:53:30,151::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7af2cbb-4b9f-4330-9221-4410fbe21a76`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:53:30,151::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:53:30,151::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000332975', 'lastCheck': '1.4', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000302627', 'lastCheck': '1.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:53:30,151::task::1191::Storage.TaskManager.Task::(prepare) Task=`a7af2cbb-4b9f-4330-9221-4410fbe21a76`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000332975', 'lastCheck': '1.4', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000302627', 'lastCheck': '1.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:53:30,151::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7af2cbb-4b9f-4330-9221-4410fbe21a76`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:53:30,151::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:53:30,151::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:53:30,152::task::993::Storage.TaskManager.Task::(_decref) Task=`a7af2cbb-4b9f-4330-9221-4410fbe21a76`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:53:31,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:31,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113381 s, 90.3 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:53:33,569::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:53:33,570::task::595::Storage.TaskManager.Task::(_updateState) Task=`307adbe3-9bff-4676-a219-6169f04ff988`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:53:33,570::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:53:33,581::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:53:33,582::task::1191::Storage.TaskManager.Task::(prepare) Task=`307adbe3-9bff-4676-a219-6169f04ff988`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:53:33,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`307adbe3-9bff-4676-a219-6169f04ff988`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:53:33,582::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:53:33,582::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:53:33,582::task::993::Storage.TaskManager.Task::(_decref) Task=`307adbe3-9bff-4676-a219-6169f04ff988`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:53:33,611::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:53:33,612::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7be8f6d-1cbb-49ec-923b-2da43ae6d840`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:53:33,612::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:53:33,612::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`a99d497f-8613-42e4-91da-29819855f2dd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:53:33,612::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:53:33,612::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:53:33,612::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`a99d497f-8613-42e4-91da-29819855f2dd`::Granted request >Thread-38::DEBUG::2014-09-16 10:53:33,613::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d7be8f6d-1cbb-49ec-923b-2da43ae6d840`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:53:33,613::task::993::Storage.TaskManager.Task::(_decref) Task=`d7be8f6d-1cbb-49ec-923b-2da43ae6d840`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:53:33,625::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:53:33,625::task::1191::Storage.TaskManager.Task::(prepare) Task=`d7be8f6d-1cbb-49ec-923b-2da43ae6d840`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:53:33,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7be8f6d-1cbb-49ec-923b-2da43ae6d840`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:53:33,625::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:53:33,625::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:53:33,625::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:53:33,625::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:53:33,625::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:53:33,625::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:53:33,625::task::993::Storage.TaskManager.Task::(_decref) Task=`d7be8f6d-1cbb-49ec-923b-2da43ae6d840`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:53:33,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:33,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113894 s, 89.9 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:53:35,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:35,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113694 s, 90.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:53:37,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:37,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113829 s, 90.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:38,796::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:38,796::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:38,797::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:38,797::__init__::232::IOProcess::(_processLogs) (41460) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:38,797::__init__::232::IOProcess::(_processLogs) (41460) Queuing response >Thread-47::DEBUG::2014-09-16 10:53:38,797::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:53:38,803::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000312254 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:38,803::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:38,804::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:38,804::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:38,804::__init__::232::IOProcess::(_processLogs) (41461) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:38,804::__init__::232::IOProcess::(_processLogs) (41461) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:38,894::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:38,894::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:38,894::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:38,894::__init__::232::IOProcess::(_processLogs) (41462) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:38,895::__init__::232::IOProcess::(_processLogs) (41462) Queuing response >Thread-21::DEBUG::2014-09-16 10:53:38,895::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:53:38,901::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000299703 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:38,901::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:38,902::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:38,902::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:38,902::__init__::232::IOProcess::(_processLogs) (41463) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:38,902::__init__::232::IOProcess::(_processLogs) (41463) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:38,903::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:38,903::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:38,903::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:38,903::__init__::232::IOProcess::(_processLogs) (41464) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:38,903::__init__::232::IOProcess::(_processLogs) (41464) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:38,903::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:38,904::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:38,904::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:38,904::__init__::232::IOProcess::(_processLogs) (41465) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:38,904::__init__::232::IOProcess::(_processLogs) (41465) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:38,904::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:38,904::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:38,905::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:38,905::__init__::232::IOProcess::(_processLogs) (41466) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:38,905::__init__::232::IOProcess::(_processLogs) (41466) Queuing response >Dummy-37::DEBUG::2014-09-16 10:53:39,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:39,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119398 s, 85.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:53:41,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:41,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0203281 s, 50.4 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:53:43,842::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:53:43,842::task::595::Storage.TaskManager.Task::(_updateState) Task=`6332da25-1322-47cc-b7ac-3b1fad93ba2d`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:53:43,843::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:53:43,854::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:53:43,854::task::1191::Storage.TaskManager.Task::(prepare) Task=`6332da25-1322-47cc-b7ac-3b1fad93ba2d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:53:43,854::task::595::Storage.TaskManager.Task::(_updateState) Task=`6332da25-1322-47cc-b7ac-3b1fad93ba2d`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:53:43,854::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:53:43,854::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:53:43,854::task::993::Storage.TaskManager.Task::(_decref) Task=`6332da25-1322-47cc-b7ac-3b1fad93ba2d`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:53:43,887::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:53:43,887::task::595::Storage.TaskManager.Task::(_updateState) Task=`26837f92-f8bd-46de-bf6d-e5addd2ed048`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:53:43,887::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:53:43,888::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`8718254c-6836-4cbb-ae8e-fb833213fcab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:53:43,888::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:53:43,888::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:53:43,888::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`8718254c-6836-4cbb-ae8e-fb833213fcab`::Granted request >Thread-38::DEBUG::2014-09-16 10:53:43,888::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`26837f92-f8bd-46de-bf6d-e5addd2ed048`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:53:43,888::task::993::Storage.TaskManager.Task::(_decref) Task=`26837f92-f8bd-46de-bf6d-e5addd2ed048`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:53:43,900::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:53:43,901::task::1191::Storage.TaskManager.Task::(prepare) Task=`26837f92-f8bd-46de-bf6d-e5addd2ed048`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:53:43,901::task::595::Storage.TaskManager.Task::(_updateState) Task=`26837f92-f8bd-46de-bf6d-e5addd2ed048`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:53:43,901::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:53:43,901::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:53:43,901::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:53:43,901::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:53:43,901::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:53:43,901::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:53:43,901::task::993::Storage.TaskManager.Task::(_decref) Task=`26837f92-f8bd-46de-bf6d-e5addd2ed048`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:53:43,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:44,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113685 s, 90.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:53:46,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:46,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113475 s, 90.2 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:53:46,167::task::595::Storage.TaskManager.Task::(_updateState) Task=`f86b6c27-07b0-4045-8a6a-65a3d8a17427`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:53:46,167::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:53:46,168::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000312254', 'lastCheck': '7.4', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000299703', 'lastCheck': '7.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:53:46,168::task::1191::Storage.TaskManager.Task::(prepare) Task=`f86b6c27-07b0-4045-8a6a-65a3d8a17427`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000312254', 'lastCheck': '7.4', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000299703', 'lastCheck': '7.3', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:53:46,168::task::595::Storage.TaskManager.Task::(_updateState) Task=`f86b6c27-07b0-4045-8a6a-65a3d8a17427`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:53:46,168::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:53:46,168::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:53:46,168::task::993::Storage.TaskManager.Task::(_decref) Task=`f86b6c27-07b0-4045-8a6a-65a3d8a17427`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:53:48,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:48,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113187 s, 90.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:48,805::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:48,805::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:48,805::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:48,805::__init__::232::IOProcess::(_processLogs) (41467) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:48,806::__init__::232::IOProcess::(_processLogs) (41467) Queuing response >Thread-47::DEBUG::2014-09-16 10:53:48,806::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:53:48,812::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000293364 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:48,813::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:48,813::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:48,813::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:48,813::__init__::232::IOProcess::(_processLogs) (41468) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:48,813::__init__::232::IOProcess::(_processLogs) (41468) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:48,906::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:48,906::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:48,907::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:48,907::__init__::232::IOProcess::(_processLogs) (41469) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:48,907::__init__::232::IOProcess::(_processLogs) (41469) Queuing response >Thread-21::DEBUG::2014-09-16 10:53:48,907::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:53:48,913::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000302111 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:48,914::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:48,914::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:48,914::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:48,914::__init__::232::IOProcess::(_processLogs) (41470) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:48,914::__init__::232::IOProcess::(_processLogs) (41470) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:48,915::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:48,915::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:48,915::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:48,915::__init__::232::IOProcess::(_processLogs) (41471) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:48,915::__init__::232::IOProcess::(_processLogs) (41471) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:48,916::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:48,916::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:48,916::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:48,916::__init__::232::IOProcess::(_processLogs) (41472) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:48,916::__init__::232::IOProcess::(_processLogs) (41472) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:48,917::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:48,917::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:48,917::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:48,917::__init__::232::IOProcess::(_processLogs) (41473) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:48,917::__init__::232::IOProcess::(_processLogs) (41473) Queuing response >Dummy-37::DEBUG::2014-09-16 10:53:50,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:50,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113334 s, 90.4 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:53:52,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:52,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113196 s, 90.5 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:53:54,258::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:53:54,258::task::595::Storage.TaskManager.Task::(_updateState) Task=`2df5486a-815c-4129-85b3-6d830278f34f`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:53:54,258::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Dummy-37::DEBUG::2014-09-16 10:53:54,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-97::INFO::2014-09-16 10:53:55,651::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:53:55,651::task::1191::Storage.TaskManager.Task::(prepare) Task=`2df5486a-815c-4129-85b3-6d830278f34f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:53:55,651::task::595::Storage.TaskManager.Task::(_updateState) Task=`2df5486a-815c-4129-85b3-6d830278f34f`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:53:55,651::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:53:55,651::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:53:55,651::task::993::Storage.TaskManager.Task::(_decref) Task=`2df5486a-815c-4129-85b3-6d830278f34f`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:53:55,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0142167 s, 72.0 MB/s\n'; <rc> = 0 >Thread-38::DEBUG::2014-09-16 10:53:55,689::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:53:55,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1b78463-3fce-4a2f-9956-4103dcb5545d`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:53:55,691::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:53:55,692::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`2c6bcb67-e944-403b-9d65-f7af7bf76a2e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:53:55,692::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:53:55,693::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:53:55,693::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`2c6bcb67-e944-403b-9d65-f7af7bf76a2e`::Granted request >Thread-38::DEBUG::2014-09-16 10:53:55,694::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b1b78463-3fce-4a2f-9956-4103dcb5545d`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:53:55,695::task::993::Storage.TaskManager.Task::(_decref) Task=`b1b78463-3fce-4a2f-9956-4103dcb5545d`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:53:55,710::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:53:55,710::task::1191::Storage.TaskManager.Task::(prepare) Task=`b1b78463-3fce-4a2f-9956-4103dcb5545d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:53:55,710::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1b78463-3fce-4a2f-9956-4103dcb5545d`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:53:55,710::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:53:55,710::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:53:55,710::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:53:55,710::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:53:55,710::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:53:55,710::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:53:55,711::task::993::Storage.TaskManager.Task::(_decref) Task=`b1b78463-3fce-4a2f-9956-4103dcb5545d`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:53:57,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:57,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113374 s, 90.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:58,814::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:58,815::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:58,815::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:58,815::__init__::232::IOProcess::(_processLogs) (41474) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:58,815::__init__::232::IOProcess::(_processLogs) (41474) Queuing response >Thread-47::DEBUG::2014-09-16 10:53:58,815::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:53:58,821::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000328025 s, 991 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:58,822::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:58,822::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:58,822::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:58,822::__init__::232::IOProcess::(_processLogs) (41475) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:58,822::__init__::232::IOProcess::(_processLogs) (41475) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:58,918::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:58,918::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:58,918::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:58,918::__init__::232::IOProcess::(_processLogs) (41476) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:58,918::__init__::232::IOProcess::(_processLogs) (41476) Queuing response >Thread-21::DEBUG::2014-09-16 10:53:58,919::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:53:58,924::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000300635 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:53:58,925::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:58,925::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:58,925::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:58,925::__init__::232::IOProcess::(_processLogs) (41477) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:53:58,925::__init__::232::IOProcess::(_processLogs) (41477) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:58,926::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:58,926::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:58,926::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:58,926::__init__::232::IOProcess::(_processLogs) (41478) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:58,927::__init__::232::IOProcess::(_processLogs) (41478) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:58,927::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:58,927::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:58,927::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:58,927::__init__::232::IOProcess::(_processLogs) (41479) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:58,927::__init__::232::IOProcess::(_processLogs) (41479) Queuing response >Thread-14::DEBUG::2014-09-16 10:53:58,928::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:53:58,928::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:53:58,928::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:53:58,928::__init__::232::IOProcess::(_processLogs) (41480) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:53:58,928::__init__::232::IOProcess::(_processLogs) (41480) Queuing response >Dummy-37::DEBUG::2014-09-16 10:53:59,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:53:59,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113271 s, 90.4 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:54:01,664::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b37b18d-3a5a-4102-a71d-f0b4ab5e3078`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:54:01,664::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:54:01,664::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000328025', 'lastCheck': '2.8', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300635', 'lastCheck': '2.7', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:54:01,664::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b37b18d-3a5a-4102-a71d-f0b4ab5e3078`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000328025', 'lastCheck': '2.8', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300635', 'lastCheck': '2.7', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:54:01,665::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b37b18d-3a5a-4102-a71d-f0b4ab5e3078`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:54:01,665::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:54:01,665::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:54:01,665::task::993::Storage.TaskManager.Task::(_decref) Task=`4b37b18d-3a5a-4102-a71d-f0b4ab5e3078`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:54:01,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:01,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118243 s, 86.6 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:54:03,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:03,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113912 s, 89.9 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:54:05,865::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:54:05,865::task::595::Storage.TaskManager.Task::(_updateState) Task=`4edb0ac6-68e7-4ef7-9ecc-3497d2a381c0`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:54:05,865::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:54:05,877::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:54:05,877::task::1191::Storage.TaskManager.Task::(prepare) Task=`4edb0ac6-68e7-4ef7-9ecc-3497d2a381c0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:54:05,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`4edb0ac6-68e7-4ef7-9ecc-3497d2a381c0`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:54:05,877::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:54:05,877::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:54:05,877::task::993::Storage.TaskManager.Task::(_decref) Task=`4edb0ac6-68e7-4ef7-9ecc-3497d2a381c0`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:54:05,908::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:54:05,908::task::595::Storage.TaskManager.Task::(_updateState) Task=`eacaa75c-5393-48b9-9b3c-22b1d795ecbb`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:54:05,908::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:54:05,908::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`753ec030-2ac6-447a-886b-d798cb94e707`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:54:05,908::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:54:05,908::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:54:05,909::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`753ec030-2ac6-447a-886b-d798cb94e707`::Granted request >Thread-38::DEBUG::2014-09-16 10:54:05,909::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`eacaa75c-5393-48b9-9b3c-22b1d795ecbb`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:54:05,909::task::993::Storage.TaskManager.Task::(_decref) Task=`eacaa75c-5393-48b9-9b3c-22b1d795ecbb`::ref 1 aborting False >Dummy-37::DEBUG::2014-09-16 10:54:05,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:05,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114073 s, 89.8 MB/s\n'; <rc> = 0 >Thread-38::INFO::2014-09-16 10:54:05,952::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:54:05,953::task::1191::Storage.TaskManager.Task::(prepare) Task=`eacaa75c-5393-48b9-9b3c-22b1d795ecbb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:54:05,954::task::595::Storage.TaskManager.Task::(_updateState) Task=`eacaa75c-5393-48b9-9b3c-22b1d795ecbb`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:54:05,954::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:54:05,955::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:54:05,956::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:54:05,957::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:54:05,957::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:54:05,958::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:54:05,959::task::993::Storage.TaskManager.Task::(_decref) Task=`eacaa75c-5393-48b9-9b3c-22b1d795ecbb`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:54:07,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:08,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112548 s, 91.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:54:08,823::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:08,823::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:08,823::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:08,824::__init__::232::IOProcess::(_processLogs) (41481) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:08,824::__init__::232::IOProcess::(_processLogs) (41481) Queuing response >Thread-47::DEBUG::2014-09-16 10:54:08,824::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:54:08,830::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000332286 s, 978 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:54:08,830::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:08,831::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:08,831::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:08,831::__init__::232::IOProcess::(_processLogs) (41482) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:08,831::__init__::232::IOProcess::(_processLogs) (41482) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:08,929::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:08,929::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:08,929::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:08,929::__init__::232::IOProcess::(_processLogs) (41483) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:08,930::__init__::232::IOProcess::(_processLogs) (41483) Queuing response >Thread-21::DEBUG::2014-09-16 10:54:08,930::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:54:08,936::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000312981 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:54:08,936::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:08,937::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:08,937::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:08,937::__init__::232::IOProcess::(_processLogs) (41484) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:08,937::__init__::232::IOProcess::(_processLogs) (41484) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:08,938::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:08,938::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:08,938::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:08,938::__init__::232::IOProcess::(_processLogs) (41485) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:08,938::__init__::232::IOProcess::(_processLogs) (41485) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:08,939::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:08,939::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:08,939::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:08,939::__init__::232::IOProcess::(_processLogs) (41486) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:08,939::__init__::232::IOProcess::(_processLogs) (41486) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:08,939::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:08,940::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:08,940::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:08,940::__init__::232::IOProcess::(_processLogs) (41487) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:08,940::__init__::232::IOProcess::(_processLogs) (41487) Queuing response >Dummy-37::DEBUG::2014-09-16 10:54:10,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:10,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112649 s, 90.9 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:54:12,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:12,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113348 s, 90.3 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:54:14,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:14,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0167745 s, 61.0 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:54:16,098::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:54:16,098::task::595::Storage.TaskManager.Task::(_updateState) Task=`127bd0aa-4c8c-4ab6-baf9-dd750f39acf6`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:54:16,098::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:54:16,109::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:54:16,110::task::1191::Storage.TaskManager.Task::(prepare) Task=`127bd0aa-4c8c-4ab6-baf9-dd750f39acf6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:54:16,110::task::595::Storage.TaskManager.Task::(_updateState) Task=`127bd0aa-4c8c-4ab6-baf9-dd750f39acf6`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:54:16,110::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:54:16,110::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:54:16,110::task::993::Storage.TaskManager.Task::(_decref) Task=`127bd0aa-4c8c-4ab6-baf9-dd750f39acf6`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:54:16,141::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:54:16,141::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad92c7a5-6089-45a9-9225-469f5f74c7f2`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:54:16,141::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:54:16,141::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`be317a6a-d8a8-4832-8609-3f688580884d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:54:16,141::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:54:16,142::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:54:16,142::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`be317a6a-d8a8-4832-8609-3f688580884d`::Granted request >Thread-38::DEBUG::2014-09-16 10:54:16,142::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ad92c7a5-6089-45a9-9225-469f5f74c7f2`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:54:16,143::task::993::Storage.TaskManager.Task::(_decref) Task=`ad92c7a5-6089-45a9-9225-469f5f74c7f2`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:54:16,154::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:54:16,155::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad92c7a5-6089-45a9-9225-469f5f74c7f2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:54:16,155::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad92c7a5-6089-45a9-9225-469f5f74c7f2`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:54:16,155::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:54:16,155::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:54:16,155::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:54:16,155::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:54:16,155::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:54:16,155::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:54:16,155::task::993::Storage.TaskManager.Task::(_decref) Task=`ad92c7a5-6089-45a9-9225-469f5f74c7f2`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:54:16,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:16,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112933 s, 90.7 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:54:17,668::task::595::Storage.TaskManager.Task::(_updateState) Task=`161f555a-0e96-4ff6-9b14-4fce8adb4880`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:54:17,669::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:54:17,669::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000332286', 'lastCheck': '8.8', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000312981', 'lastCheck': '8.7', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:54:17,669::task::1191::Storage.TaskManager.Task::(prepare) Task=`161f555a-0e96-4ff6-9b14-4fce8adb4880`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000332286', 'lastCheck': '8.8', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000312981', 'lastCheck': '8.7', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:54:17,669::task::595::Storage.TaskManager.Task::(_updateState) Task=`161f555a-0e96-4ff6-9b14-4fce8adb4880`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:54:17,669::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:54:17,669::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:54:17,669::task::993::Storage.TaskManager.Task::(_decref) Task=`161f555a-0e96-4ff6-9b14-4fce8adb4880`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:54:18,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:18,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112641 s, 90.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:54:18,832::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:18,832::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:18,832::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:18,832::__init__::232::IOProcess::(_processLogs) (41488) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:18,833::__init__::232::IOProcess::(_processLogs) (41488) Queuing response >Thread-47::DEBUG::2014-09-16 10:54:18,833::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:54:18,839::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000324449 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:54:18,839::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:18,839::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:18,840::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:18,840::__init__::232::IOProcess::(_processLogs) (41489) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:18,840::__init__::232::IOProcess::(_processLogs) (41489) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:18,941::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:18,941::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:18,941::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:18,941::__init__::232::IOProcess::(_processLogs) (41490) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:18,941::__init__::232::IOProcess::(_processLogs) (41490) Queuing response >Thread-21::DEBUG::2014-09-16 10:54:18,942::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:54:18,947::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000321396 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:54:18,948::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:18,948::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:18,948::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:18,948::__init__::232::IOProcess::(_processLogs) (41491) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:18,948::__init__::232::IOProcess::(_processLogs) (41491) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:18,949::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:18,949::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:18,949::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:18,949::__init__::232::IOProcess::(_processLogs) (41492) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:18,949::__init__::232::IOProcess::(_processLogs) (41492) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:18,950::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:18,950::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:18,950::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:18,950::__init__::232::IOProcess::(_processLogs) (41493) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:18,950::__init__::232::IOProcess::(_processLogs) (41493) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:18,951::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:18,951::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:18,951::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:18,951::__init__::232::IOProcess::(_processLogs) (41494) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:18,951::__init__::232::IOProcess::(_processLogs) (41494) Queuing response >Dummy-37::DEBUG::2014-09-16 10:54:20,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:20,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112913 s, 90.7 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:54:22,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:22,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0111469 s, 91.9 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:54:24,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:24,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113642 s, 90.1 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:54:26,256::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] flowID [62c73b14] >Thread-97::DEBUG::2014-09-16 10:54:26,257::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6b58650-6a80-458d-b5a7-cf8e7862d08a`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:54:26,257::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:54:26,269::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:54:26,269::task::1191::Storage.TaskManager.Task::(prepare) Task=`f6b58650-6a80-458d-b5a7-cf8e7862d08a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:54:26,269::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6b58650-6a80-458d-b5a7-cf8e7862d08a`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:54:26,269::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:54:26,269::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:54:26,269::task::993::Storage.TaskManager.Task::(_decref) Task=`f6b58650-6a80-458d-b5a7-cf8e7862d08a`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:54:26,305::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] flowID [62c73b14] >Thread-38::DEBUG::2014-09-16 10:54:26,305::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf62f727-e871-4f53-ba00-63d52c422e31`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:54:26,305::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:54:26,305::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`420bbb55-d0be-4e94-b7b5-ec051f25dc07`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:54:26,305::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:54:26,305::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:54:26,306::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`420bbb55-d0be-4e94-b7b5-ec051f25dc07`::Granted request >Thread-38::DEBUG::2014-09-16 10:54:26,306::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bf62f727-e871-4f53-ba00-63d52c422e31`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:54:26,306::task::993::Storage.TaskManager.Task::(_decref) Task=`bf62f727-e871-4f53-ba00-63d52c422e31`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:54:26,318::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:54:26,318::task::1191::Storage.TaskManager.Task::(prepare) Task=`bf62f727-e871-4f53-ba00-63d52c422e31`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:54:26,318::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf62f727-e871-4f53-ba00-63d52c422e31`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:54:26,318::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:54:26,318::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:54:26,318::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:54:26,318::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:54:26,319::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:54:26,319::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:54:26,319::task::993::Storage.TaskManager.Task::(_decref) Task=`bf62f727-e871-4f53-ba00-63d52c422e31`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:54:26,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:26,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113584 s, 90.2 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:54:28,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:28,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112736 s, 90.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:54:28,841::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:28,841::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:28,841::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:28,841::__init__::232::IOProcess::(_processLogs) (41495) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:28,841::__init__::232::IOProcess::(_processLogs) (41495) Queuing response >Thread-47::DEBUG::2014-09-16 10:54:28,842::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:54:28,847::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000307993 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:54:28,848::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:28,848::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:28,848::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:28,849::__init__::232::IOProcess::(_processLogs) (41496) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:28,849::__init__::232::IOProcess::(_processLogs) (41496) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:28,952::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:28,952::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:28,952::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:28,952::__init__::232::IOProcess::(_processLogs) (41497) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:28,952::__init__::232::IOProcess::(_processLogs) (41497) Queuing response >Thread-21::DEBUG::2014-09-16 10:54:28,953::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:54:28,958::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000303761 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:54:28,959::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:28,959::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:28,959::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:28,959::__init__::232::IOProcess::(_processLogs) (41498) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:28,959::__init__::232::IOProcess::(_processLogs) (41498) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:28,960::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:28,960::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:28,960::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:28,961::__init__::232::IOProcess::(_processLogs) (41499) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:28,961::__init__::232::IOProcess::(_processLogs) (41499) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:28,961::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:28,961::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:28,961::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:28,961::__init__::232::IOProcess::(_processLogs) (41500) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:28,961::__init__::232::IOProcess::(_processLogs) (41500) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:28,962::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:28,962::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:28,962::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:28,962::__init__::232::IOProcess::(_processLogs) (41501) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:28,962::__init__::232::IOProcess::(_processLogs) (41501) Queuing response >Dummy-37::DEBUG::2014-09-16 10:54:30,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:30,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113526 s, 90.2 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:54:32,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:32,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113128 s, 90.5 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:54:33,981::task::595::Storage.TaskManager.Task::(_updateState) Task=`9598c46b-b26d-46d7-b8d3-46f8fd603d04`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:54:33,981::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:54:33,981::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000307993', 'lastCheck': '5.1', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303761', 'lastCheck': '5.0', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:54:33,981::task::1191::Storage.TaskManager.Task::(prepare) Task=`9598c46b-b26d-46d7-b8d3-46f8fd603d04`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000307993', 'lastCheck': '5.1', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303761', 'lastCheck': '5.0', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:54:33,981::task::595::Storage.TaskManager.Task::(_updateState) Task=`9598c46b-b26d-46d7-b8d3-46f8fd603d04`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:54:33,981::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:54:33,981::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:54:33,981::task::993::Storage.TaskManager.Task::(_decref) Task=`9598c46b-b26d-46d7-b8d3-46f8fd603d04`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:54:34,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:34,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113658 s, 90.1 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:54:36,467::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:54:36,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`aefae012-1b84-483d-afc8-88822ffe7bd4`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:54:36,467::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:54:36,479::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:54:36,479::task::1191::Storage.TaskManager.Task::(prepare) Task=`aefae012-1b84-483d-afc8-88822ffe7bd4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:54:36,479::task::595::Storage.TaskManager.Task::(_updateState) Task=`aefae012-1b84-483d-afc8-88822ffe7bd4`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:54:36,479::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:54:36,479::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:54:36,479::task::993::Storage.TaskManager.Task::(_decref) Task=`aefae012-1b84-483d-afc8-88822ffe7bd4`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:54:36,510::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:54:36,510::task::595::Storage.TaskManager.Task::(_updateState) Task=`82dd2c54-2de4-47d4-ba43-7832fd67c8a9`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:54:36,510::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:54:36,510::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`51269d1e-cf91-4641-a232-76b2fbdb394f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:54:36,510::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:54:36,511::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:54:36,511::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`51269d1e-cf91-4641-a232-76b2fbdb394f`::Granted request >Thread-38::DEBUG::2014-09-16 10:54:36,511::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`82dd2c54-2de4-47d4-ba43-7832fd67c8a9`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:54:36,511::task::993::Storage.TaskManager.Task::(_decref) Task=`82dd2c54-2de4-47d4-ba43-7832fd67c8a9`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:54:36,523::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:54:36,523::task::1191::Storage.TaskManager.Task::(prepare) Task=`82dd2c54-2de4-47d4-ba43-7832fd67c8a9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:54:36,523::task::595::Storage.TaskManager.Task::(_updateState) Task=`82dd2c54-2de4-47d4-ba43-7832fd67c8a9`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:54:36,523::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:54:36,523::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:54:36,523::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:54:36,524::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:54:36,524::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:54:36,524::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:54:36,524::task::993::Storage.TaskManager.Task::(_decref) Task=`82dd2c54-2de4-47d4-ba43-7832fd67c8a9`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:54:36,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:36,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113506 s, 90.2 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:54:38,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:38,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113482 s, 90.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:54:38,850::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:38,850::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:38,850::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:38,850::__init__::232::IOProcess::(_processLogs) (41502) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:38,850::__init__::232::IOProcess::(_processLogs) (41502) Queuing response >Thread-47::DEBUG::2014-09-16 10:54:38,851::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:54:38,857::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000321506 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:54:38,857::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:38,857::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:38,857::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:38,858::__init__::232::IOProcess::(_processLogs) (41503) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:38,858::__init__::232::IOProcess::(_processLogs) (41503) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:38,963::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:38,963::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:38,963::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:38,963::__init__::232::IOProcess::(_processLogs) (41504) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:38,964::__init__::232::IOProcess::(_processLogs) (41504) Queuing response >Thread-21::DEBUG::2014-09-16 10:54:38,965::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:54:38,970::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000315555 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:54:38,971::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:38,971::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:38,971::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:38,971::__init__::232::IOProcess::(_processLogs) (41505) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:38,971::__init__::232::IOProcess::(_processLogs) (41505) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:38,972::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:38,972::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:38,972::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:38,973::__init__::232::IOProcess::(_processLogs) (41506) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:38,973::__init__::232::IOProcess::(_processLogs) (41506) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:38,973::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:38,973::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:38,973::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:38,973::__init__::232::IOProcess::(_processLogs) (41507) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:38,973::__init__::232::IOProcess::(_processLogs) (41507) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:38,974::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:38,974::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:38,974::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:38,974::__init__::232::IOProcess::(_processLogs) (41508) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:38,974::__init__::232::IOProcess::(_processLogs) (41508) Queuing response >Dummy-37::DEBUG::2014-09-16 10:54:40,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:40,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112809 s, 90.8 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:54:42,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:42,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113601 s, 90.1 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:54:44,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:44,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0168296 s, 60.8 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:54:46,682::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:54:46,682::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5f3054d-61a9-45d5-b140-7526af9e8c8f`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:54:46,683::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:54:46,694::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:54:46,694::task::1191::Storage.TaskManager.Task::(prepare) Task=`f5f3054d-61a9-45d5-b140-7526af9e8c8f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:54:46,694::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5f3054d-61a9-45d5-b140-7526af9e8c8f`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:54:46,694::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:54:46,694::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:54:46,694::task::993::Storage.TaskManager.Task::(_decref) Task=`f5f3054d-61a9-45d5-b140-7526af9e8c8f`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:54:46,723::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:54:46,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b53f31d-eb4e-455d-8f62-b959688daa70`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:54:46,724::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:54:46,724::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`c1d8c04e-9103-48dd-b496-639c95c9f578`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:54:46,724::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:54:46,724::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:54:46,724::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`c1d8c04e-9103-48dd-b496-639c95c9f578`::Granted request >Thread-38::DEBUG::2014-09-16 10:54:46,724::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0b53f31d-eb4e-455d-8f62-b959688daa70`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:54:46,724::task::993::Storage.TaskManager.Task::(_decref) Task=`0b53f31d-eb4e-455d-8f62-b959688daa70`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:54:46,737::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:54:46,737::task::1191::Storage.TaskManager.Task::(prepare) Task=`0b53f31d-eb4e-455d-8f62-b959688daa70`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:54:46,737::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b53f31d-eb4e-455d-8f62-b959688daa70`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:54:46,737::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:54:46,737::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:54:46,737::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:54:46,737::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:54:46,737::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:54:46,737::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:54:46,737::task::993::Storage.TaskManager.Task::(_decref) Task=`0b53f31d-eb4e-455d-8f62-b959688daa70`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:54:47,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:47,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112918 s, 90.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:54:48,859::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:48,859::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:48,859::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:48,859::__init__::232::IOProcess::(_processLogs) (41509) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:48,859::__init__::232::IOProcess::(_processLogs) (41509) Queuing response >Thread-47::DEBUG::2014-09-16 10:54:48,860::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg02/97e2f375-6db7-43a3-81ad-ebbb94f94408/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-47::DEBUG::2014-09-16 10:54:48,866::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n325 bytes (325 B) copied, 0.000332926 s, 976 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:54:48,866::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:48,866::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:48,867::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:48,867::__init__::232::IOProcess::(_processLogs) (41510) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:48,867::__init__::232::IOProcess::(_processLogs) (41510) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:48,975::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:48,975::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:48,975::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:48,976::__init__::232::IOProcess::(_processLogs) (41511) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:48,976::__init__::232::IOProcess::(_processLogs) (41511) Queuing response >Thread-21::DEBUG::2014-09-16 10:54:48,976::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:54:48,981::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000332434 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:54:48,982::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:48,982::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:48,982::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:48,983::__init__::232::IOProcess::(_processLogs) (41512) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:48,983::__init__::232::IOProcess::(_processLogs) (41512) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:48,983::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:48,984::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:48,984::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:48,984::__init__::232::IOProcess::(_processLogs) (41513) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:48,984::__init__::232::IOProcess::(_processLogs) (41513) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:48,984::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:48,984::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:48,985::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:48,985::__init__::232::IOProcess::(_processLogs) (41514) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:48,985::__init__::232::IOProcess::(_processLogs) (41514) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:48,985::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:48,985::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:48,985::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:48,986::__init__::232::IOProcess::(_processLogs) (41515) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:48,986::__init__::232::IOProcess::(_processLogs) (41515) Queuing response >Dummy-37::DEBUG::2014-09-16 10:54:49,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:49,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113319 s, 90.4 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:54:49,344::task::595::Storage.TaskManager.Task::(_updateState) Task=`91d0c6ed-3ef1-4887-9e91-3ba4a1decc25`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:54:49,344::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:54:49,345::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000332926', 'lastCheck': '0.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332434', 'lastCheck': '0.4', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:54:49,345::task::1191::Storage.TaskManager.Task::(prepare) Task=`91d0c6ed-3ef1-4887-9e91-3ba4a1decc25`::finished: {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000332926', 'lastCheck': '0.5', 'valid': True}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332434', 'lastCheck': '0.4', 'valid': True}} >Thread-97::DEBUG::2014-09-16 10:54:49,345::task::595::Storage.TaskManager.Task::(_updateState) Task=`91d0c6ed-3ef1-4887-9e91-3ba4a1decc25`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:54:49,345::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:54:49,345::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:54:49,345::task::993::Storage.TaskManager.Task::(_decref) Task=`91d0c6ed-3ef1-4887-9e91-3ba4a1decc25`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:54:51,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:51,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113401 s, 90.3 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:54:53,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:53,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113734 s, 90.0 MB/s\n'; <rc> = 0 >Dummy-37::DEBUG::2014-09-16 10:54:55,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:55,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113538 s, 90.2 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:54:56,898::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:54:56,898::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f18deef-c9c0-4c4b-97d1-dbfb1f7c287f`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:54:56,898::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::INFO::2014-09-16 10:54:56,909::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:54:56,910::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f18deef-c9c0-4c4b-97d1-dbfb1f7c287f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-97::DEBUG::2014-09-16 10:54:56,910::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f18deef-c9c0-4c4b-97d1-dbfb1f7c287f`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:54:56,910::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:54:56,910::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:54:56,910::task::993::Storage.TaskManager.Task::(_decref) Task=`0f18deef-c9c0-4c4b-97d1-dbfb1f7c287f`::ref 0 aborting False >Thread-38::DEBUG::2014-09-16 10:54:56,957::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-38::DEBUG::2014-09-16 10:54:56,958::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f671b62-88e6-4213-bc59-0da5becccf60`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:54:56,958::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-38::DEBUG::2014-09-16 10:54:56,958::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`0769c99b-9d15-4b1e-8345-cb5caa8e7805`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-38::DEBUG::2014-09-16 10:54:56,958::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-38::DEBUG::2014-09-16 10:54:56,958::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-38::DEBUG::2014-09-16 10:54:56,958::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`0769c99b-9d15-4b1e-8345-cb5caa8e7805`::Granted request >Thread-38::DEBUG::2014-09-16 10:54:56,959::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9f671b62-88e6-4213-bc59-0da5becccf60`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (shared) >Thread-38::DEBUG::2014-09-16 10:54:56,959::task::993::Storage.TaskManager.Task::(_decref) Task=`9f671b62-88e6-4213-bc59-0da5becccf60`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:54:56,971::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:54:56,971::task::1191::Storage.TaskManager.Task::(prepare) Task=`9f671b62-88e6-4213-bc59-0da5becccf60`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '97e2f375-6db7-43a3-81ad-ebbb94f94408:Active,b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'master_uuid': u'b66bf4f1-94ad-487c-aa76-34598a679d7b', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'97e2f375-6db7-43a3-81ad-ebbb94f94408': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 0}, 'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'status': 'Active', 'diskfree': '132516052992', 'isoprefix': '', 'alerts': [], 'disktotal': '143325954048', 'version': 3}}} >Thread-38::DEBUG::2014-09-16 10:54:56,971::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f671b62-88e6-4213-bc59-0da5becccf60`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:54:56,971::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:54:56,971::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:54:56,971::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:54:56,972::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:54:56,972::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:54:56,972::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:54:56,972::task::993::Storage.TaskManager.Task::(_decref) Task=`9f671b62-88e6-4213-bc59-0da5becccf60`::ref 0 aborting False >Dummy-37::DEBUG::2014-09-16 10:54:57,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:57,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112847 s, 90.7 MB/s\n'; <rc> = 0 >Thread-38::DEBUG::2014-09-16 10:54:57,524::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] flowID [522f8f8] >Thread-38::DEBUG::2014-09-16 10:54:57,524::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3d0f1c6-19e2-44c0-bd3a-53c1c93d4db0`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:54:57,525::logUtils::44::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='97e2f375-6db7-43a3-81ad-ebbb94f94408', spUUID='da06caa7-b08d-4685-b49c-84565c268648', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-38::DEBUG::2014-09-16 10:54:57,525::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`4fc22cdb-02ee-4aaa-9960-2f73c7eedc5e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1227' at 'deactivateStorageDomain' >Thread-38::DEBUG::2014-09-16 10:54:57,525::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'exclusive' >Thread-38::DEBUG::2014-09-16 10:54:57,525::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'exclusive' (1 active user) >Thread-38::DEBUG::2014-09-16 10:54:57,525::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`4fc22cdb-02ee-4aaa-9960-2f73c7eedc5e`::Granted request >Thread-38::DEBUG::2014-09-16 10:54:57,525::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d3d0f1c6-19e2-44c0-bd3a-53c1c93d4db0`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (exclusive) >Thread-38::DEBUG::2014-09-16 10:54:57,526::task::993::Storage.TaskManager.Task::(_decref) Task=`d3d0f1c6-19e2-44c0-bd3a-53c1c93d4db0`::ref 1 aborting False >Thread-38::DEBUG::2014-09-16 10:54:57,526::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408`ReqID=`1239c716-7bbe-46e0-b0bc-b5e51244c3b3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1228' at 'deactivateStorageDomain' >Thread-38::DEBUG::2014-09-16 10:54:57,526::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408' for lock type 'exclusive' >Thread-38::DEBUG::2014-09-16 10:54:57,526::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408' is free. Now locking as 'exclusive' (1 active user) >Thread-38::DEBUG::2014-09-16 10:54:57,526::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408`ReqID=`1239c716-7bbe-46e0-b0bc-b5e51244c3b3`::Granted request >Thread-38::DEBUG::2014-09-16 10:54:57,527::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d3d0f1c6-19e2-44c0-bd3a-53c1c93d4db0`::_resourcesAcquired: Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408 (exclusive) >Thread-38::DEBUG::2014-09-16 10:54:57,527::task::993::Storage.TaskManager.Task::(_decref) Task=`d3d0f1c6-19e2-44c0-bd3a-53c1c93d4db0`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:54:57,527::sp::1070::Storage.StoragePool::(deactivateSD) sdUUID=97e2f375-6db7-43a3-81ad-ebbb94f94408 spUUID=da06caa7-b08d-4685-b49c-84565c268648 newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-38::INFO::2014-09-16 10:54:57,528::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'97e2f375-6db7-43a3-81ad-ebbb94f94408': 'Attached', 'b66bf4f1-94ad-487c-aa76-34598a679d7b': 'Active'} >Thread-38::DEBUG::2014-09-16 10:54:57,528::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-38::DEBUG::2014-09-16 10:54:57,528::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-38::INFO::2014-09-16 10:54:57,528::domainMonitor::114::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 97e2f375-6db7-43a3-81ad-ebbb94f94408 >Thread-47::DEBUG::2014-09-16 10:54:57,528::domainMonitor::192::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 97e2f375-6db7-43a3-81ad-ebbb94f94408 >Thread-47::DEBUG::2014-09-16 10:54:57,529::clusterlock::116::Storage.SafeLease::(releaseHostId) Host id for domain 97e2f375-6db7-43a3-81ad-ebbb94f94408 released successfully (id: 1) >Thread-38::DEBUG::2014-09-16 10:54:57,529::sp::1407::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `da06caa7-b08d-4685-b49c-84565c268648` stopped monitoring domain `97e2f375-6db7-43a3-81ad-ebbb94f94408` >Thread-38::DEBUG::2014-09-16 10:54:57,529::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-38::INFO::2014-09-16 10:54:57,529::logUtils::47::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-38::DEBUG::2014-09-16 10:54:57,529::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3d0f1c6-19e2-44c0-bd3a-53c1c93d4db0`::finished: None >Thread-38::DEBUG::2014-09-16 10:54:57,529::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3d0f1c6-19e2-44c0-bd3a-53c1c93d4db0`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:54:57,529::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>, 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408': < ResourceRef 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:54:57,529::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:54:57,529::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:54:57,530::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:54:57,530::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:54:57,530::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:54:57,530::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408' >Thread-38::DEBUG::2014-09-16 10:54:57,530::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408' (0 active users) >Thread-38::DEBUG::2014-09-16 10:54:57,530::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:54:57,530::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.97e2f375-6db7-43a3-81ad-ebbb94f94408', Clearing records. >Thread-38::DEBUG::2014-09-16 10:54:57,530::task::993::Storage.TaskManager.Task::(_decref) Task=`d3d0f1c6-19e2-44c0-bd3a-53c1c93d4db0`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:54:57,594::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] >Thread-97::DEBUG::2014-09-16 10:54:57,595::task::595::Storage.TaskManager.Task::(_updateState) Task=`108979f9-7b17-4c6c-ae25-84acdf359288`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:54:57,595::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='da06caa7-b08d-4685-b49c-84565c268648', hostID=1, msdUUID='b66bf4f1-94ad-487c-aa76-34598a679d7b', masterVersion=1, domainsMap={'97e2f375-6db7-43a3-81ad-ebbb94f94408': 'attached', 'b66bf4f1-94ad-487c-aa76-34598a679d7b': 'active'}, options=None) >Thread-97::DEBUG::2014-09-16 10:54:57,595::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`6968ad50-6272-46ae-8a08-6ff45fde146e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-97::DEBUG::2014-09-16 10:54:57,595::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-97::DEBUG::2014-09-16 10:54:57,595::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-97::DEBUG::2014-09-16 10:54:57,595::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`6968ad50-6272-46ae-8a08-6ff45fde146e`::Granted request >Thread-97::DEBUG::2014-09-16 10:54:57,595::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`8c5d2a84-9342-4521-bbbd-49929fc4d997`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-97::DEBUG::2014-09-16 10:54:57,596::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'shared' >Thread-97::DEBUG::2014-09-16 10:54:57,596::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'shared' (1 active user) >Thread-97::DEBUG::2014-09-16 10:54:57,596::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`8c5d2a84-9342-4521-bbbd-49929fc4d997`::Granted request >Thread-97::DEBUG::2014-09-16 10:54:57,596::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'97e2f375-6db7-43a3-81ad-ebbb94f94408': 'attached', 'b66bf4f1-94ad-487c-aa76-34598a679d7b': 'active'} >Thread-97::INFO::2014-09-16 10:54:57,596::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'97e2f375-6db7-43a3-81ad-ebbb94f94408': 'Attached', 'b66bf4f1-94ad-487c-aa76-34598a679d7b': 'Active'} >Thread-97::DEBUG::2014-09-16 10:54:57,596::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:57,596::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:57,596::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:57,597::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:57,597::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:57,597::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:57,597::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-97::DEBUG::2014-09-16 10:54:57,597::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-97::DEBUG::2014-09-16 10:54:57,597::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-97::DEBUG::2014-09-16 10:54:57,597::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-97::DEBUG::2014-09-16 10:54:57,597::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-97::DEBUG::2014-09-16 10:54:57,597::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-97::DEBUG::2014-09-16 10:54:57,726::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-97::DEBUG::2014-09-16 10:54:57,735::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-97::DEBUG::2014-09-16 10:54:57,995::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:54:57,996::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:57,996::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:57,996::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:57,996::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:57,996::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:57,996::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:57,997::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-09-16 10:54:57,998::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:58,002::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:58,002::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:58,002::__init__::232::IOProcess::(_processLogs) (41516) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:54:58,003::__init__::232::IOProcess::(_processLogs) (41516) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:58,003::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:58,004::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:58,004::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:58,004::__init__::232::IOProcess::(_processLogs) (41517) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:54:58,004::__init__::232::IOProcess::(_processLogs) (41517) Queuing response >Thread-97::DEBUG::2014-09-16 10:54:58,006::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b >Thread-14::DEBUG::2014-09-16 10:54:58,007::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:58,007::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:58,007::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:58,007::__init__::232::IOProcess::(_processLogs) (41518) Got request for method 'touch' >Thread-14::DEBUG::2014-09-16 10:54:58,008::__init__::232::IOProcess::(_processLogs) (41518) Queuing response >Thread-97::DEBUG::2014-09-16 10:54:58,008::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14::DEBUG::2014-09-16 10:54:58,008::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:58,008::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:58,009::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:58,009::__init__::232::IOProcess::(_processLogs) (41519) Got request for method 'readfile' >Thread-14::DEBUG::2014-09-16 10:54:58,009::__init__::232::IOProcess::(_processLogs) (41519) Queuing response >Thread-97::DEBUG::2014-09-16 10:54:58,009::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nfs_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Global_DC_1', 'POOL_DOMAINS=b66bf4f1-94ad-487c-aa76-34598a679d7b:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=da06caa7-b08d-4685-b49c-84565c268648', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Master', 'SDUUID=b66bf4f1-94ad-487c-aa76-34598a679d7b', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=895c938b406aa5adedd20a81fb4f17d5cf909767'] >Thread-14::DEBUG::2014-09-16 10:54:58,010::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:58,010::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:58,010::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:58,010::__init__::232::IOProcess::(_processLogs) (41520) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:58,010::__init__::232::IOProcess::(_processLogs) (41520) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:58,010::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:58,010::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:58,010::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:58,011::__init__::232::IOProcess::(_processLogs) (41521) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:54:58,011::__init__::232::IOProcess::(_processLogs) (41521) Queuing response >Thread-97::DEBUG::2014-09-16 10:54:58,011::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-97::INFO::2014-09-16 10:54:58,011::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b66bf4f1-94ad-487c-aa76-34598a679d7b_imageNS already registered >Thread-97::INFO::2014-09-16 10:54:58,011::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b66bf4f1-94ad-487c-aa76-34598a679d7b_volumeNS already registered >Thread-97::DEBUG::2014-09-16 10:54:58,011::sp::1390::Storage.StoragePool::(setMasterDomain) Master domain b66bf4f1-94ad-487c-aa76-34598a679d7b verified, version 1 >Thread-97::DEBUG::2014-09-16 10:54:58,011::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-97::DEBUG::2014-09-16 10:54:58,011::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-97::DEBUG::2014-09-16 10:54:58,012::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-97::DEBUG::2014-09-16 10:54:58,012::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648 >Thread-97::WARNING::2014-09-16 10:54:58,012::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648 already exists >Thread-97::DEBUG::2014-09-16 10:54:58,017::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:58,038::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >Thread-97::DEBUG::2014-09-16 10:54:58,262::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:54:58,263::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-09-16 10:54:58,265::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:58,266::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:58,266::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:58,266::__init__::232::IOProcess::(_processLogs) (41522) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:54:58,266::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:58,266::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:58,266::__init__::232::IOProcess::(_processLogs) (41522) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:58,266::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:58,266::__init__::232::IOProcess::(_processLogs) (41523) Got request for method 'glob' >Thread-14::DEBUG::2014-09-16 10:54:58,267::__init__::232::IOProcess::(_processLogs) (41523) Queuing response >Thread-97::INFO::2014-09-16 10:54:58,268::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b to /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/b66bf4f1-94ad-487c-aa76-34598a679d7b >Thread-97::DEBUG::2014-09-16 10:54:58,268::sp::1131::Storage.StoragePool::(_linkStorageDomain) link already present skipping creation for /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/b66bf4f1-94ad-487c-aa76-34598a679d7b >Thread-97::INFO::2014-09-16 10:54:58,268::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b to /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd >Thread-97::DEBUG::2014-09-16 10:54:58,268::sp::1131::Storage.StoragePool::(_linkStorageDomain) link already present skipping creation for /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd >Thread-97::DEBUG::2014-09-16 10:54:58,268::sp::1221::Storage.StoragePool::(__rebuild) collecting stale storage domain link /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/97e2f375-6db7-43a3-81ad-ebbb94f94408 >Thread-97::DEBUG::2014-09-16 10:54:58,281::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-97::DEBUG::2014-09-16 10:54:58,281::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-97::DEBUG::2014-09-16 10:54:58,281::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-97::DEBUG::2014-09-16 10:54:58,281::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-97::DEBUG::2014-09-16 10:54:58,281::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-97::DEBUG::2014-09-16 10:54:58,281::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-97::DEBUG::2014-09-16 10:54:58,281::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-97::DEBUG::2014-09-16 10:54:58,282::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-97::INFO::2014-09-16 10:54:58,282::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-97::DEBUG::2014-09-16 10:54:58,282::task::1191::Storage.TaskManager.Task::(prepare) Task=`108979f9-7b17-4c6c-ae25-84acdf359288`::finished: True >Thread-97::DEBUG::2014-09-16 10:54:58,282::task::595::Storage.TaskManager.Task::(_updateState) Task=`108979f9-7b17-4c6c-ae25-84acdf359288`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:54:58,282::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:54:58,282::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:54:58,282::task::993::Storage.TaskManager.Task::(_decref) Task=`108979f9-7b17-4c6c-ae25-84acdf359288`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:54:58,363::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] flowID [427d3ce4] >Thread-97::DEBUG::2014-09-16 10:54:58,363::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6f747c5-e3e2-4cf1-8596-d403107aafba`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:54:58,363::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg02', 'iqn': '', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'ddad194a-3f91-4153-b11c-dc1168b239bd', 'port': ''}], options=None) >Thread-97::DEBUG::2014-09-16 10:54:58,364::mount::227::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.34.63.199:_cmg02 (cwd None) >Thread-97::DEBUG::2014-09-16 10:54:58,913::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-97::DEBUG::2014-09-16 10:54:58,913::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-97::DEBUG::2014-09-16 10:54:58,913::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-97::DEBUG::2014-09-16 10:54:58,913::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-97::DEBUG::2014-09-16 10:54:58,914::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-97::DEBUG::2014-09-16 10:54:58,914::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-97::DEBUG::2014-09-16 10:54:58,923::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-97::DEBUG::2014-09-16 10:54:58,928::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-97::DEBUG::2014-09-16 10:54:58,981::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:54:58,981::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:58,981::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:58,982::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:58,982::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:58,982::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:58,982::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-97::DEBUG::2014-09-16 10:54:58,982::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-97::INFO::2014-09-16 10:54:58,982::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'ddad194a-3f91-4153-b11c-dc1168b239bd'}]} >Thread-97::DEBUG::2014-09-16 10:54:58,982::task::1191::Storage.TaskManager.Task::(prepare) Task=`e6f747c5-e3e2-4cf1-8596-d403107aafba`::finished: {'statuslist': [{'status': 0, 'id': 'ddad194a-3f91-4153-b11c-dc1168b239bd'}]} >Thread-97::DEBUG::2014-09-16 10:54:58,982::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6f747c5-e3e2-4cf1-8596-d403107aafba`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:54:58,982::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:54:58,983::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:54:58,983::task::993::Storage.TaskManager.Task::(_decref) Task=`e6f747c5-e3e2-4cf1-8596-d403107aafba`::ref 0 aborting False >Thread-14::DEBUG::2014-09-16 10:54:58,987::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:58,987::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:58,987::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:58,987::__init__::232::IOProcess::(_processLogs) (41524) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:58,987::__init__::232::IOProcess::(_processLogs) (41524) Queuing response >Thread-21::DEBUG::2014-09-16 10:54:58,988::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.34.63.199:_cmg01/b66bf4f1-94ad-487c-aa76-34598a679d7b/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-21::DEBUG::2014-09-16 10:54:58,993::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n456 bytes (456 B) copied, 0.000291493 s, 1.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-16 10:54:58,994::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:58,994::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:58,994::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:58,994::__init__::232::IOProcess::(_processLogs) (41525) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-16 10:54:58,994::__init__::232::IOProcess::(_processLogs) (41525) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:58,995::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:58,995::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:58,995::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:58,996::__init__::232::IOProcess::(_processLogs) (41526) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:58,996::__init__::232::IOProcess::(_processLogs) (41526) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:58,996::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:58,996::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:58,996::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:58,996::__init__::232::IOProcess::(_processLogs) (41527) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:58,997::__init__::232::IOProcess::(_processLogs) (41527) Queuing response >Thread-14::DEBUG::2014-09-16 10:54:58,997::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-16 10:54:58,997::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-16 10:54:58,997::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-16 10:54:58,997::__init__::232::IOProcess::(_processLogs) (41528) Got request for method 'access' >Thread-14::DEBUG::2014-09-16 10:54:58,997::__init__::232::IOProcess::(_processLogs) (41528) Queuing response >Dummy-37::DEBUG::2014-09-16 10:54:59,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-37::DEBUG::2014-09-16 10:54:59,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0114001 s, 89.8 MB/s\n'; <rc> = 0 >Thread-38::DEBUG::2014-09-16 10:55:00,886::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] flowID [4d7c300f] >Thread-38::DEBUG::2014-09-16 10:55:00,886::task::595::Storage.TaskManager.Task::(_updateState) Task=`82b0cdc1-f565-4328-9316-981504c8980e`::moving from state init -> state preparing >Thread-38::INFO::2014-09-16 10:55:00,886::logUtils::44::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID='b66bf4f1-94ad-487c-aa76-34598a679d7b', spUUID='da06caa7-b08d-4685-b49c-84565c268648', msdUUID='00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-38::DEBUG::2014-09-16 10:55:00,887::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`2e1f7d6f-9932-4f63-b331-ea8717953deb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1227' at 'deactivateStorageDomain' >Thread-38::DEBUG::2014-09-16 10:55:00,887::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'exclusive' >Thread-38::DEBUG::2014-09-16 10:55:00,887::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'exclusive' (1 active user) >Thread-38::DEBUG::2014-09-16 10:55:00,887::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`2e1f7d6f-9932-4f63-b331-ea8717953deb`::Granted request >Thread-38::DEBUG::2014-09-16 10:55:00,887::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`82b0cdc1-f565-4328-9316-981504c8980e`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (exclusive) >Thread-38::DEBUG::2014-09-16 10:55:00,887::task::993::Storage.TaskManager.Task::(_decref) Task=`82b0cdc1-f565-4328-9316-981504c8980e`::ref 1 aborting False >Thread-38::DEBUG::2014-09-16 10:55:00,887::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b`ReqID=`c7c0fa62-35b5-4bad-977c-3b76c0bf1f38`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1228' at 'deactivateStorageDomain' >Thread-38::DEBUG::2014-09-16 10:55:00,887::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b' for lock type 'exclusive' >Thread-38::DEBUG::2014-09-16 10:55:00,888::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b' is free. Now locking as 'exclusive' (1 active user) >Thread-38::DEBUG::2014-09-16 10:55:00,888::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b`ReqID=`c7c0fa62-35b5-4bad-977c-3b76c0bf1f38`::Granted request >Thread-38::DEBUG::2014-09-16 10:55:00,888::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`82b0cdc1-f565-4328-9316-981504c8980e`::_resourcesAcquired: Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b (exclusive) >Thread-38::DEBUG::2014-09-16 10:55:00,888::task::993::Storage.TaskManager.Task::(_decref) Task=`82b0cdc1-f565-4328-9316-981504c8980e`::ref 1 aborting False >Thread-38::INFO::2014-09-16 10:55:00,888::sp::1070::Storage.StoragePool::(deactivateSD) sdUUID=b66bf4f1-94ad-487c-aa76-34598a679d7b spUUID=da06caa7-b08d-4685-b49c-84565c268648 newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-38::INFO::2014-09-16 10:55:00,888::sp::1094::Storage.StoragePool::(deactivateSD) Silently ignoring the deactivation request for the master domain b66bf4f1-94ad-487c-aa76-34598a679d7b >Thread-38::INFO::2014-09-16 10:55:00,888::logUtils::47::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-38::DEBUG::2014-09-16 10:55:00,888::task::1191::Storage.TaskManager.Task::(prepare) Task=`82b0cdc1-f565-4328-9316-981504c8980e`::finished: None >Thread-38::DEBUG::2014-09-16 10:55:00,888::task::595::Storage.TaskManager.Task::(_updateState) Task=`82b0cdc1-f565-4328-9316-981504c8980e`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-16 10:55:00,889::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>, 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b': < ResourceRef 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b', isValid: 'True' obj: 'None'>} >Thread-38::DEBUG::2014-09-16 10:55:00,889::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-16 10:55:00,889::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-38::DEBUG::2014-09-16 10:55:00,889::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-38::DEBUG::2014-09-16 10:55:00,889::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:55:00,889::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-38::DEBUG::2014-09-16 10:55:00,889::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b' >Thread-38::DEBUG::2014-09-16 10:55:00,889::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b' (0 active users) >Thread-38::DEBUG::2014-09-16 10:55:00,889::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b' is free, finding out if anyone is waiting for it. >Thread-38::DEBUG::2014-09-16 10:55:00,889::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b66bf4f1-94ad-487c-aa76-34598a679d7b', Clearing records. >Thread-38::DEBUG::2014-09-16 10:55:00,889::task::993::Storage.TaskManager.Task::(_decref) Task=`82b0cdc1-f565-4328-9316-981504c8980e`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:55:00,916::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] flowID [4d7c300f] >Thread-97::DEBUG::2014-09-16 10:55:00,916::task::595::Storage.TaskManager.Task::(_updateState) Task=`414cede9-51ae-4f3d-afdf-c3154839f9be`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:55:00,917::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-97::DEBUG::2014-09-16 10:55:00,917::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-97::DEBUG::2014-09-16 10:55:00,917::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {} >Thread-97::INFO::2014-09-16 10:55:00,917::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}} >Thread-97::DEBUG::2014-09-16 10:55:00,917::task::1191::Storage.TaskManager.Task::(prepare) Task=`414cede9-51ae-4f3d-afdf-c3154839f9be`::finished: {'allTasksStatus': {}} >Thread-97::DEBUG::2014-09-16 10:55:00,917::task::595::Storage.TaskManager.Task::(_updateState) Task=`414cede9-51ae-4f3d-afdf-c3154839f9be`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:55:00,917::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:55:00,917::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:55:00,918::task::993::Storage.TaskManager.Task::(_decref) Task=`414cede9-51ae-4f3d-afdf-c3154839f9be`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:55:00,941::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] flowID [4d7c300f] >Thread-97::DEBUG::2014-09-16 10:55:00,941::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9affeab-e206-4c5c-b048-25c888eabf4e`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:55:00,942::logUtils::44::dispatcher::(wrapper) Run and protect: spmStop(spUUID='da06caa7-b08d-4685-b49c-84565c268648', options=None) >Thread-97::DEBUG::2014-09-16 10:55:00,942::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`3083d209-d4d5-4f23-9901-36586fe035a4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '596' at 'spmStop' >Thread-97::DEBUG::2014-09-16 10:55:00,942::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'exclusive' >Thread-97::DEBUG::2014-09-16 10:55:00,942::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'exclusive' (1 active user) >Thread-97::DEBUG::2014-09-16 10:55:00,942::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`3083d209-d4d5-4f23-9901-36586fe035a4`::Granted request >Thread-97::DEBUG::2014-09-16 10:55:00,942::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d9affeab-e206-4c5c-b048-25c888eabf4e`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (exclusive) >Thread-97::DEBUG::2014-09-16 10:55:00,942::task::993::Storage.TaskManager.Task::(_decref) Task=`d9affeab-e206-4c5c-b048-25c888eabf4e`::ref 1 aborting False >Thread-97::DEBUG::2014-09-16 10:55:00,942::sp::337::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-97::DEBUG::2014-09-16 10:55:00,943::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.upgrade_da06caa7-b08d-4685-b49c-84565c268648`ReqID=`8d4f21b2-06b9-4b87-8a10-8826a9f7fef8`::Request was made in '/usr/share/vdsm/storage/sp.py' line '339' at '_shutDownUpgrade' >Thread-97::DEBUG::2014-09-16 10:55:00,943::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_da06caa7-b08d-4685-b49c-84565c268648' for lock type 'exclusive' >Thread-97::DEBUG::2014-09-16 10:55:00,943::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.upgrade_da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'exclusive' (1 active user) >Thread-97::DEBUG::2014-09-16 10:55:00,943::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.upgrade_da06caa7-b08d-4685-b49c-84565c268648`ReqID=`8d4f21b2-06b9-4b87-8a10-8826a9f7fef8`::Granted request >Thread-97::DEBUG::2014-09-16 10:55:00,943::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_da06caa7-b08d-4685-b49c-84565c268648' >Thread-97::DEBUG::2014-09-16 10:55:00,943::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.upgrade_da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-97::DEBUG::2014-09-16 10:55:00,943::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.upgrade_da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-97::DEBUG::2014-09-16 10:55:00,943::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-97::INFO::2014-09-16 10:55:00,944::clusterlock::339::Storage.SANLock::(release) Releasing cluster lock for domain b66bf4f1-94ad-487c-aa76-34598a679d7b >Thread-97::DEBUG::2014-09-16 10:55:00,952::clusterlock::349::Storage.SANLock::(release) Cluster lock for domain b66bf4f1-94ad-487c-aa76-34598a679d7b successfully released >Thread-97::INFO::2014-09-16 10:55:00,952::logUtils::47::dispatcher::(wrapper) Run and protect: spmStop, Return response: None >Thread-97::DEBUG::2014-09-16 10:55:00,952::task::1191::Storage.TaskManager.Task::(prepare) Task=`d9affeab-e206-4c5c-b048-25c888eabf4e`::finished: None >Thread-97::DEBUG::2014-09-16 10:55:00,952::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9affeab-e206-4c5c-b048-25c888eabf4e`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:55:00,952::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-97::DEBUG::2014-09-16 10:55:00,952::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:55:00,952::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-97::DEBUG::2014-09-16 10:55:00,953::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-97::DEBUG::2014-09-16 10:55:00,953::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-97::DEBUG::2014-09-16 10:55:00,953::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-97::DEBUG::2014-09-16 10:55:00,953::task::993::Storage.TaskManager.Task::(_decref) Task=`d9affeab-e206-4c5c-b048-25c888eabf4e`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:55:01,156::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] flowID [4d7c300f] >Thread-97::DEBUG::2014-09-16 10:55:01,156::task::595::Storage.TaskManager.Task::(_updateState) Task=`2dfc64ce-34b9-4c51-b0be-35941c4189e9`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:55:01,157::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='da06caa7-b08d-4685-b49c-84565c268648', hostID=1, remove=False, options=None) >Thread-97::DEBUG::2014-09-16 10:55:01,157::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`17cb812e-7e63-45dc-b051-bc317bc0156c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1124' at 'disconnectStoragePool' >Thread-97::DEBUG::2014-09-16 10:55:01,157::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' for lock type 'exclusive' >Thread-97::DEBUG::2014-09-16 10:55:01,157::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free. Now locking as 'exclusive' (1 active user) >Thread-97::DEBUG::2014-09-16 10:55:01,157::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.da06caa7-b08d-4685-b49c-84565c268648`ReqID=`17cb812e-7e63-45dc-b051-bc317bc0156c`::Granted request >Thread-97::DEBUG::2014-09-16 10:55:01,157::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2dfc64ce-34b9-4c51-b0be-35941c4189e9`::_resourcesAcquired: Storage.da06caa7-b08d-4685-b49c-84565c268648 (exclusive) >Thread-97::DEBUG::2014-09-16 10:55:01,157::task::993::Storage.TaskManager.Task::(_decref) Task=`2dfc64ce-34b9-4c51-b0be-35941c4189e9`::ref 1 aborting False >Thread-97::DEBUG::2014-09-16 10:55:01,158::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`e0e0b178-0595-4aba-a873-8c4ecd3c1c38`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1132' at '_disconnectPool' >Thread-97::DEBUG::2014-09-16 10:55:01,158::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-97::DEBUG::2014-09-16 10:55:01,158::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-97::DEBUG::2014-09-16 10:55:01,158::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`e0e0b178-0595-4aba-a873-8c4ecd3c1c38`::Granted request >Thread-97::INFO::2014-09-16 10:55:01,158::sp::657::Storage.StoragePool::(disconnect) Disconnect from the storage pool da06caa7-b08d-4685-b49c-84565c268648 >Thread-30::INFO::2014-09-16 10:55:03,019::storage_mailbox::509::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail >Thread-30::INFO::2014-09-16 10:55:03,019::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-30::DEBUG::2014-09-16 10:55:03,019::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd of=/rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8 (cwd None) >Thread-30::DEBUG::2014-09-16 10:55:03,031::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0065218 s, 628 kB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:55:04,033::fileUtils::124::Storage.fileUtils::(cleanupdir) Removing directory: /rhev/data-center/da06caa7-b08d-4685-b49c-84565c268648 >Thread-97::INFO::2014-09-16 10:55:04,042::domainMonitor::114::Storage.DomainMonitor::(stopMonitoring) Stop monitoring b66bf4f1-94ad-487c-aa76-34598a679d7b >Thread-21::DEBUG::2014-09-16 10:55:04,042::domainMonitor::192::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for b66bf4f1-94ad-487c-aa76-34598a679d7b >Thread-21::INFO::2014-09-16 10:55:04,042::clusterlock::245::Storage.SANLock::(releaseHostId) Releasing host id for domain b66bf4f1-94ad-487c-aa76-34598a679d7b (id: 1) >Dummy-37::INFO::2014-09-16 10:55:04,279::storage_mailbox::792::Storage.MailBox.SpmMailMonitor::(run) SPM_MailMonitor - Incoming mail monitoring thread stopped >Thread-148::DEBUG::2014-09-16 10:55:05,106::task::595::Storage.TaskManager.Task::(_updateState) Task=`876deb8c-af41-4cec-9da4-21c1a809f7c2`::moving from state init -> state preparing >Thread-148::INFO::2014-09-16 10:55:05,106::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-148::INFO::2014-09-16 10:55:05,106::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000291493', 'lastCheck': '6.1', 'valid': True}} >Thread-148::DEBUG::2014-09-16 10:55:05,106::task::1191::Storage.TaskManager.Task::(prepare) Task=`876deb8c-af41-4cec-9da4-21c1a809f7c2`::finished: {'b66bf4f1-94ad-487c-aa76-34598a679d7b': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000291493', 'lastCheck': '6.1', 'valid': True}} >Thread-148::DEBUG::2014-09-16 10:55:05,107::task::595::Storage.TaskManager.Task::(_updateState) Task=`876deb8c-af41-4cec-9da4-21c1a809f7c2`::moving from state preparing -> state finished >Thread-148::DEBUG::2014-09-16 10:55:05,107::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-148::DEBUG::2014-09-16 10:55:05,107::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-148::DEBUG::2014-09-16 10:55:05,107::task::993::Storage.TaskManager.Task::(_decref) Task=`876deb8c-af41-4cec-9da4-21c1a809f7c2`::ref 0 aborting False >Thread-21::DEBUG::2014-09-16 10:55:07,042::clusterlock::255::Storage.SANLock::(releaseHostId) Host id for domain b66bf4f1-94ad-487c-aa76-34598a679d7b released successfully (id: 1) >Thread-97::DEBUG::2014-09-16 10:55:07,043::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-97::DEBUG::2014-09-16 10:55:07,043::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-97::DEBUG::2014-09-16 10:55:07,043::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-97::DEBUG::2014-09-16 10:55:07,043::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-97::INFO::2014-09-16 10:55:07,043::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True >Thread-97::DEBUG::2014-09-16 10:55:07,043::task::1191::Storage.TaskManager.Task::(prepare) Task=`2dfc64ce-34b9-4c51-b0be-35941c4189e9`::finished: True >Thread-97::DEBUG::2014-09-16 10:55:07,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`2dfc64ce-34b9-4c51-b0be-35941c4189e9`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:55:07,043::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.da06caa7-b08d-4685-b49c-84565c268648': < ResourceRef 'Storage.da06caa7-b08d-4685-b49c-84565c268648', isValid: 'True' obj: 'None'>} >Thread-97::DEBUG::2014-09-16 10:55:07,044::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:55:07,044::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' >Thread-97::DEBUG::2014-09-16 10:55:07,044::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' (0 active users) >Thread-97::DEBUG::2014-09-16 10:55:07,044::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648' is free, finding out if anyone is waiting for it. >Thread-97::DEBUG::2014-09-16 10:55:07,044::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.da06caa7-b08d-4685-b49c-84565c268648', Clearing records. >Thread-97::DEBUG::2014-09-16 10:55:07,044::task::993::Storage.TaskManager.Task::(_decref) Task=`2dfc64ce-34b9-4c51-b0be-35941c4189e9`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:55:07,077::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] flowID [4d7c300f] >Thread-97::DEBUG::2014-09-16 10:55:07,078::task::595::Storage.TaskManager.Task::(_updateState) Task=`130f2bbc-8c05-4653-a4fd-e92e933a8c96`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:55:07,078::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='da06caa7-b08d-4685-b49c-84565c268648', hostID=1, remove=False, options=None) >Thread-97::WARNING::2014-09-16 10:55:07,078::hsm::1119::Storage.HSM::(disconnectStoragePool) disconnect sp: da06caa7-b08d-4685-b49c-84565c268648 failed. Known pools {} >Thread-97::INFO::2014-09-16 10:55:07,078::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: None >Thread-97::DEBUG::2014-09-16 10:55:07,078::task::1191::Storage.TaskManager.Task::(prepare) Task=`130f2bbc-8c05-4653-a4fd-e92e933a8c96`::finished: None >Thread-97::DEBUG::2014-09-16 10:55:07,078::task::595::Storage.TaskManager.Task::(_updateState) Task=`130f2bbc-8c05-4653-a4fd-e92e933a8c96`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:55:07,078::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:55:07,078::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:55:07,078::task::993::Storage.TaskManager.Task::(_decref) Task=`130f2bbc-8c05-4653-a4fd-e92e933a8c96`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:55:07,188::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] flowID [1e668f5d] >Thread-97::DEBUG::2014-09-16 10:55:07,188::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d51afb0-3483-4076-8b02-44f618b071c5`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:55:07,188::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'user': '', 'tpgt': '1', 'password': '******', 'id': '69600649-59b6-469f-b223-4bcf28494402', 'port': ''}], options=None) >Thread-97::DEBUG::2014-09-16 10:55:07,189::mount::227::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.34.63.199:_cmg01 (cwd None) >Thread-97::DEBUG::2014-09-16 10:55:07,224::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-97::DEBUG::2014-09-16 10:55:07,224::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-97::DEBUG::2014-09-16 10:55:07,225::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-97::DEBUG::2014-09-16 10:55:07,225::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-97::DEBUG::2014-09-16 10:55:07,225::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-97::DEBUG::2014-09-16 10:55:07,225::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-97::DEBUG::2014-09-16 10:55:07,234::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-97::DEBUG::2014-09-16 10:55:07,235::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-97::DEBUG::2014-09-16 10:55:07,280::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:55:07,280::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-97::DEBUG::2014-09-16 10:55:07,280::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-97::DEBUG::2014-09-16 10:55:07,281::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-97::DEBUG::2014-09-16 10:55:07,281::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-97::DEBUG::2014-09-16 10:55:07,281::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-97::DEBUG::2014-09-16 10:55:07,281::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-97::DEBUG::2014-09-16 10:55:07,281::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-97::INFO::2014-09-16 10:55:07,281::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '69600649-59b6-469f-b223-4bcf28494402'}]} >Thread-97::DEBUG::2014-09-16 10:55:07,281::task::1191::Storage.TaskManager.Task::(prepare) Task=`7d51afb0-3483-4076-8b02-44f618b071c5`::finished: {'statuslist': [{'status': 0, 'id': '69600649-59b6-469f-b223-4bcf28494402'}]} >Thread-97::DEBUG::2014-09-16 10:55:07,282::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d51afb0-3483-4076-8b02-44f618b071c5`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:55:07,282::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:55:07,282::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:55:07,282::task::993::Storage.TaskManager.Task::(_decref) Task=`7d51afb0-3483-4076-8b02-44f618b071c5`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:55:07,331::BindingXMLRPC::318::vds::(wrapper) client [10.34.63.25] flowID [8f82425] >Thread-97::DEBUG::2014-09-16 10:55:07,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf7d2927-994b-4aca-870f-e247550aefe3`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:55:07,332::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'user': '', 'tpgt': '1', 'password': '******', 'id': '69600649-59b6-469f-b223-4bcf28494402', 'port': ''}], options=None) >Thread-97::DEBUG::2014-09-16 10:55:07,332::mount::227::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.34.63.199:_cmg01 (cwd None) >Thread-97::ERROR::2014-09-16 10:55:07,347::hsm::2531::Storage.HSM::(disconnectStorageServer) Could not disconnect from storageServer >Traceback (most recent call last): > File "/usr/share/vdsm/storage/hsm.py", line 2527, in disconnectStorageServer > conObj.disconnect() > File "/usr/share/vdsm/storage/storageServer.py", line 334, in disconnect > return self._mountCon.disconnect() > File "/usr/share/vdsm/storage/storageServer.py", line 235, in disconnect > self._mount.umount(True, True) > File "/usr/share/vdsm/storage/mount.py", line 254, in umount > return self._runcmd(cmd, timeout) > File "/usr/share/vdsm/storage/mount.py", line 239, in _runcmd > raise MountError(rc, ";".join((out, err))) >MountError: (1, ';umount: /rhev/data-center/mnt/10.34.63.199:_cmg01: not found\n') >Thread-97::DEBUG::2014-09-16 10:55:07,420::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-97::DEBUG::2014-09-16 10:55:07,420::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-97::DEBUG::2014-09-16 10:55:07,420::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-97::DEBUG::2014-09-16 10:55:07,420::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-97::DEBUG::2014-09-16 10:55:07,420::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-97::DEBUG::2014-09-16 10:55:07,420::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-97::DEBUG::2014-09-16 10:55:07,429::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-97::DEBUG::2014-09-16 10:55:07,430::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-97::DEBUG::2014-09-16 10:55:07,470::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-97::DEBUG::2014-09-16 10:55:07,470::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-97::DEBUG::2014-09-16 10:55:07,471::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-97::DEBUG::2014-09-16 10:55:07,471::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-97::DEBUG::2014-09-16 10:55:07,471::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-97::DEBUG::2014-09-16 10:55:07,471::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-97::DEBUG::2014-09-16 10:55:07,471::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-97::DEBUG::2014-09-16 10:55:07,471::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-97::INFO::2014-09-16 10:55:07,471::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 477, 'id': '69600649-59b6-469f-b223-4bcf28494402'}]} >Thread-97::DEBUG::2014-09-16 10:55:07,472::task::1191::Storage.TaskManager.Task::(prepare) Task=`bf7d2927-994b-4aca-870f-e247550aefe3`::finished: {'statuslist': [{'status': 477, 'id': '69600649-59b6-469f-b223-4bcf28494402'}]} >Thread-97::DEBUG::2014-09-16 10:55:07,472::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf7d2927-994b-4aca-870f-e247550aefe3`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:55:07,472::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:55:07,472::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:55:07,472::task::993::Storage.TaskManager.Task::(_decref) Task=`bf7d2927-994b-4aca-870f-e247550aefe3`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:55:20,765::task::595::Storage.TaskManager.Task::(_updateState) Task=`3337f5d4-2f55-4d7a-8a4e-aaaf40a0ad13`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:55:20,765::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:55:20,765::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-97::DEBUG::2014-09-16 10:55:20,765::task::1191::Storage.TaskManager.Task::(prepare) Task=`3337f5d4-2f55-4d7a-8a4e-aaaf40a0ad13`::finished: {} >Thread-97::DEBUG::2014-09-16 10:55:20,766::task::595::Storage.TaskManager.Task::(_updateState) Task=`3337f5d4-2f55-4d7a-8a4e-aaaf40a0ad13`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:55:20,766::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:55:20,766::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:55:20,766::task::993::Storage.TaskManager.Task::(_decref) Task=`3337f5d4-2f55-4d7a-8a4e-aaaf40a0ad13`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:55:36,115::task::595::Storage.TaskManager.Task::(_updateState) Task=`4dd1a7d9-d583-4363-939f-4e4b8dab3c6b`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:55:36,115::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:55:36,121::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-97::DEBUG::2014-09-16 10:55:36,121::task::1191::Storage.TaskManager.Task::(prepare) Task=`4dd1a7d9-d583-4363-939f-4e4b8dab3c6b`::finished: {} >Thread-97::DEBUG::2014-09-16 10:55:36,121::task::595::Storage.TaskManager.Task::(_updateState) Task=`4dd1a7d9-d583-4363-939f-4e4b8dab3c6b`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:55:36,121::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:55:36,121::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:55:36,121::task::993::Storage.TaskManager.Task::(_decref) Task=`4dd1a7d9-d583-4363-939f-4e4b8dab3c6b`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:55:51,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`de4d9ab7-71ea-4805-afcf-e6adf6833bbe`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:55:51,965::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:55:51,965::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-97::DEBUG::2014-09-16 10:55:51,965::task::1191::Storage.TaskManager.Task::(prepare) Task=`de4d9ab7-71ea-4805-afcf-e6adf6833bbe`::finished: {} >Thread-97::DEBUG::2014-09-16 10:55:51,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`de4d9ab7-71ea-4805-afcf-e6adf6833bbe`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:55:51,965::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:55:51,965::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:55:51,965::task::993::Storage.TaskManager.Task::(_decref) Task=`de4d9ab7-71ea-4805-afcf-e6adf6833bbe`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:56:07,257::task::595::Storage.TaskManager.Task::(_updateState) Task=`f44c4481-92c7-4b98-a769-59495d8a1546`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:56:07,257::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:56:07,257::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-97::DEBUG::2014-09-16 10:56:07,257::task::1191::Storage.TaskManager.Task::(prepare) Task=`f44c4481-92c7-4b98-a769-59495d8a1546`::finished: {} >Thread-97::DEBUG::2014-09-16 10:56:07,257::task::595::Storage.TaskManager.Task::(_updateState) Task=`f44c4481-92c7-4b98-a769-59495d8a1546`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:56:07,257::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:56:07,257::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:56:07,258::task::993::Storage.TaskManager.Task::(_decref) Task=`f44c4481-92c7-4b98-a769-59495d8a1546`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:56:22,605::task::595::Storage.TaskManager.Task::(_updateState) Task=`53b6dae6-febe-49da-8de1-e8f4e67539c4`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:56:22,606::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:56:22,611::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-97::DEBUG::2014-09-16 10:56:22,611::task::1191::Storage.TaskManager.Task::(prepare) Task=`53b6dae6-febe-49da-8de1-e8f4e67539c4`::finished: {} >Thread-97::DEBUG::2014-09-16 10:56:22,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`53b6dae6-febe-49da-8de1-e8f4e67539c4`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:56:22,612::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:56:22,612::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:56:22,612::task::993::Storage.TaskManager.Task::(_decref) Task=`53b6dae6-febe-49da-8de1-e8f4e67539c4`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:56:37,936::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b60774d-79eb-4762-a1fb-338652af06f2`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:56:37,937::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:56:37,937::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-97::DEBUG::2014-09-16 10:56:37,937::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b60774d-79eb-4762-a1fb-338652af06f2`::finished: {} >Thread-97::DEBUG::2014-09-16 10:56:37,937::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b60774d-79eb-4762-a1fb-338652af06f2`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:56:37,937::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:56:37,937::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:56:37,937::task::993::Storage.TaskManager.Task::(_decref) Task=`8b60774d-79eb-4762-a1fb-338652af06f2`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:56:53,344::task::595::Storage.TaskManager.Task::(_updateState) Task=`a038f1dc-0519-45a1-aa52-d32ea12a06d7`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:56:53,344::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:56:53,345::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-97::DEBUG::2014-09-16 10:56:53,345::task::1191::Storage.TaskManager.Task::(prepare) Task=`a038f1dc-0519-45a1-aa52-d32ea12a06d7`::finished: {} >Thread-97::DEBUG::2014-09-16 10:56:53,345::task::595::Storage.TaskManager.Task::(_updateState) Task=`a038f1dc-0519-45a1-aa52-d32ea12a06d7`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:56:53,345::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:56:53,345::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:56:53,345::task::993::Storage.TaskManager.Task::(_decref) Task=`a038f1dc-0519-45a1-aa52-d32ea12a06d7`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:57:08,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b8303b8-a516-4509-8966-8978daa3fe11`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:57:08,951::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:57:08,951::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-97::DEBUG::2014-09-16 10:57:08,951::task::1191::Storage.TaskManager.Task::(prepare) Task=`6b8303b8-a516-4509-8966-8978daa3fe11`::finished: {} >Thread-97::DEBUG::2014-09-16 10:57:08,951::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b8303b8-a516-4509-8966-8978daa3fe11`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:57:08,951::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:57:08,951::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:57:08,951::task::993::Storage.TaskManager.Task::(_decref) Task=`6b8303b8-a516-4509-8966-8978daa3fe11`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:57:24,270::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f037915-3626-4d86-8c4c-b514f3ec0b76`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:57:24,271::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:57:24,271::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-97::DEBUG::2014-09-16 10:57:24,271::task::1191::Storage.TaskManager.Task::(prepare) Task=`3f037915-3626-4d86-8c4c-b514f3ec0b76`::finished: {} >Thread-97::DEBUG::2014-09-16 10:57:24,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f037915-3626-4d86-8c4c-b514f3ec0b76`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:57:24,271::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:57:24,271::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:57:24,271::task::993::Storage.TaskManager.Task::(_decref) Task=`3f037915-3626-4d86-8c4c-b514f3ec0b76`::ref 0 aborting False >Thread-97::DEBUG::2014-09-16 10:57:39,592::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e93f357-9db7-4944-ab7d-7a0e0b5182ce`::moving from state init -> state preparing >Thread-97::INFO::2014-09-16 10:57:39,593::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-97::INFO::2014-09-16 10:57:39,593::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-97::DEBUG::2014-09-16 10:57:39,593::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e93f357-9db7-4944-ab7d-7a0e0b5182ce`::finished: {} >Thread-97::DEBUG::2014-09-16 10:57:39,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e93f357-9db7-4944-ab7d-7a0e0b5182ce`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-09-16 10:57:39,593::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-09-16 10:57:39,593::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-09-16 10:57:39,593::task::993::Storage.TaskManager.Task::(_decref) Task=`3e93f357-9db7-4944-ab7d-7a0e0b5182ce`::ref 0 aborting False
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1128824
: 937921